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ABSTRACT 

The National Science Foundation ('NSF) and the 
Association of American Universities are conducting an experiment in 
research .grant administration designed to respond to the perceived 
needs of universi-ties for more flexibility while assuring appropriate 
accountability for Federal research funds. The experiment delegates 
most grant admi'nistration authorities to universities and' pe.rmits 
them- to' allocate costs among scientifically rela*ted NSF grants. The 
experiment is divided injjto two* phases, p'hase 1 (the Master Grant 
Phase) involved 245 grants awarded by KTSF's Chemistry Division to thd 
chemi st ry -departvmefft .af nine universities. Phase 2 (started in 
January 1981) modified and expanded the experiment to include almost, 

.all NSF gran^ts»to the nine Master Grant universities and three 
additional universities . *The U. t. General Accounting Office believes 
the ..experiment can increase the economy and efficiency oi Federal 
grant administration and, provide more f lexibility^in the use of funds 
but indicates that some operational problems need to be corrected. 
This document discusses (in separate chapters) the experiment's 

^backgi:ound , objectives/scope, ^and methodology; Master Grant Phase, 
indicated to have improved r^sjearch grant administration; the' Phase. 2 
expansion; a review indicating that the NSF experiment needs to be 
better managed and eva^luated; and conclusions/recommend^it ions . 
( Author/ Jti) ' , ' ^ ' 
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The National Science Foundation (NS^ 
andthe Association of American Uni;/er- 
sities are conducting,an experiment in 
r-esearch grant administration designed 
to respond to the perceived heeds of 
universities for more flexibility while 
assuring appropriate accountability for 
Federal research funds- The experiment 
delegates most grant administrative 
authorities to universities and permits 
them to allocate costs among scientif- 
ically related^NSF grants. GAO believes 
the experiment can increase the economy 
and efficiency of Federal research grant 
administration and provide more flexi- 
bility in the^use^pf funds. Hdwever^some 
operatiortal problems need to be 
corrected. 
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The Honorable John B. Slaughter 
Director, National Science 
Foundation . 

Dear Dr. Slaughter: 

- This report on t">ie AssQciation of American Universities- 
National Science Founjaation experiment in r&search grant 
administratip'h focuses on the Master Grant phase of the . 
experiment .and the transition to Phase II. A dr^Jft o^f this 
report was submitted to you for your review and your written ^ 
conunents are included in Appendix I and have beern consitJered 
in preparing the final report. 

This report contains recommendations to you on page 41. 
As you know, Section 236 of the Legislative Reorgajiization 
Act of 1970 requires the head of a Federal agency to submit 
a written statement on actions taken on our recommendations 
to the House Committee cjn Government Operations and the 
Seriate Committee on Governmental Affairs not later than 60 . 
days after the date of the report and to the House and Senate 
Committees on Appropriations witK the agency's first request 
for appropriations made more than ^0 'days after the* date 
the report*. 

We ar6 sending copies of tViis report to the Chairmen 
of the Senate Committee on Ggvernmental Affairs and its 
Subcommittee on Federal Expenditures, Research and Rules; 
Subcommittee on HUD-Independent Agencies, Senate Committee 
on Appropriations ? Subcommittee on Science, Research, and 
Technology, ^iouse Committee on .Science and Technology; Sub- 
committee on- Intergovernmental Relations and Human Resources, 
House Committee on Government Operations; and Subcommittee 
on* HUD-Indepen^aent Agencies, House Committee on Appropriations. 
We are also sending copies to the Director of the Office of 
Management and Budget and the Director olE your Office of Audit 
and Overslept- We will m^ke copies available to interested 
organizations and individuals on request. , , 

Sincerely yojars, 

Morton A- Myers 
Director 




-ERIC 



'Ericlos-ure 



REPORT BY THE 

UNITED STATES GENEi<AL 

ACCOUNTING OFFICE 



DIGEST 



NSF EXPERIMENT IN RESEARCH 

GRANT Administration 

PROMISING — CHANGES' .NEEDED , 
TO ASSURE ACCOUNTABILITY 



i 



American colleges-and universities have be<?ome 
* increasingly critical of the Federal system for ,| 
assuring arccountability for grants awarded to them." 
Universities hav^ argued that Federal rules tend 
to limit their flexibility in managing research 
funds, and have an eroding effect on the creativity^ 
: vital to the research process*^ Fed^eral qfficials 
have, in jturn, argued that these rules are neces- 
sary to assure that FedeiraT funds are spent in 
accordance with the terms of the research, agree- 
ments ^ without fraud or waste. ' ' ^ 

In Janviary 1979, the National Science . Foundation 
.(NSF), in collaboration with the^ Association of* 
.American Universities, undertook"^ an experiment in 
research grant administration designed to respond 
to the perceived needs of universities for flexibi- - 
iity while assuring appropriate financial accounta-^ 
bility. The primary^ objectives of the experiment are 
^to: 

— increase .economy and efficiency of research 
projects supported by NSF through increased 
sharing of resources , and greater authority ^ 
"for local decisionmaking; ' ^ 

^ ^ — f'reduce paperwork ass^ociated with administer-^ 

' ing Federal grant programs ; and ^ 

— improve accountability^ for expenditures of' 
. public funds by carefully defining the 

universities' responsibilities and providing 

standards for- decisionmjiking. ' 

The experiment is divided into two. phases*. Phase I 
(the Master Grant piiase) involved 245 grants awarded 
' by cJSF's Chemistry Division to the chemistry depart- 
ments of ni^ne unij/ersities with an award value of 
$34 million. Phase II/ whicVf ^t^rted in January 1981/ 
^ modified and expanded the , experiment to include almost 
all NSF grants to the nin^ Master Graht phase univer- 
sities and three additional universities (3,74'6 grants 
with an award value of $540 million).. 
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The experiment differs from NSF's standard adminis- 
tration system in two key areas-. First, most of the 
authority to review and approve adminiistrative* and 
-budget changes after the grant has been made now lie^ 
with each, university^' s organizational prior approval 
system (OPAS — the university management mechanism) 
instead of with -the NSF grants officers and program 
officers. Second, the experiment provides universi- 
ties and researchers more flexibility in the use of 
grant funds by allowing fund transfers betweerv grants 
^ in tKe< Master Grant phase (the aggregation concept) 
\ ^and permitting researchers to allocate costs among 
scientifically related NSF grants' in Phase II (the 
relatedness concept) • (See chapter t.) - \ 

GAO made the^ review because of increasing concern 
for accountability of Federal research funds, and 
because ^the experiment could have a significant effect 
on l^w .these funds aire administered. ^ ' 

THE MASTER G RANT PHASE IMPROVED 
RESEARCH GRANT ADMINISTRATION 
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GAO found that the Master Grant phase* delegation of , 
grant administrative authorities to the uniyersity 
OPASs increased the efficiency and economy of admin- 
istration primarily by processing grant budget * 
changes more quickly, allowing researchers to incur' ^ - . 

J>re-ciward costs to oirder equipment and hire personnel m 
in advance of thfe start date of the research qr^nt, • 
and increasing the ability of •researcher s ir^pond 
more flexibly to changing ^project needs. In addition,- 
GAO found that 13 researchers edited specific benefits 
they attr^ibuted to local OPAS approval, such as saving 
^money. 

The Master Grant phase had little effect^ on paper- 
work at the universities becaui^e OPAS actions 
stil^ needed to be documented to assure account- 
ability. At NSF/ paperwork increased since the 
master grants required a new administrative sys- 
tem overlaying the standard system, although some 
of this increase was probably a one-time effect 
due to the experiment. Overall, the flow of paper 
was reduced some between the universities and NSF 
since grant administrative changes were approved 
by the universities' OPASs instead of I^F. 

The .Mas't^s/ Grant phdse did not meet its objective 
of increasing accountability for expenditures of * 
Federal research grant funds. GAO identified 
several^ areas where better cont|[ol's are nej^ded and ^ 
found that' 'OPASs ViJ-h a review layer independent 
of the research, department initiating the request 
better assured that action^ were properly reviewed. 

• 11 



Documentation for some OPAS actions did not contain 
sufficient information to determine if applicable 
policies and procedures had been followed. ' GAO be- 
lieves accountability will suffer if NSF decisions 
to award^ funds for a given scope of work' are circum-^ 
vented by researchers doing work in other '^reas, if 
grants with special grant conditions are not closely 
monitored to assure 'OP;;iS actions do not violate the 
special grant conditions, and if OPASs approve ac- 
tions after they have already been taken. To pre- 
clu^c^e possible Anti-rDeficiency Act problems, appli- 
cable NSF re-gulations or the <^ant agreements should 
make% it clear th^'t the approval process cannot impose 
a'n obligation on the United States prior to the avail 
aoility^of an appropriation to 'fund the costs. 
( See chapter 2 . ) , 

P HASE II EXPANSION 

yPhase II expanded the experiment frorrf the partici- 
' pating chemistry departments to all participating , 
university* research departments having NSF grants. 
Pliase II modified the experiment by substituting the 
\ concept of relatedness for aggregation. Th^ related- 
' ness concept increases the researcher's flexibility 
in allocating cost? among scientifically or 'techni- 
cally related NSF gtants, thereby reducing problems 
witb (Cost transfers and time and effort reporting.' 

The OPAS remains the key feature of the experiment 
and its functions become even more critical In 
Phase II. The OPAS will continue to 'review and 
approve rese^chers ' requests to assure that dele- 
gated authorities are exercised prop^ly. In -addi- 
tion, the OPAS is responsible for^evi^wing and 
• approving requests tO/ relate re^arcYi graifts. This 
add'^itionali' responsibility will require the OPASs to 
have or have available the scientific expertise 
necessary to approve requests to relate research 
grants . 

. GAO reviewed five Master Grant phase participants 
Phase II OPAS structures. Four have a multi-layer 
structure with at least one layer independent of 
the department initiating the request. One does 
not include a review layer independent of the de-* 
partment initiating the request. At least one new 
Phase II participant is experimenting with a'n OPAS 
that may not have the scientific expertise neces- ' 
sary to review and approve relatedness requests. 

There will be some loss of financial accountability 
for individual grants that are ^scientifically 
related. Expenditures made for related research 

9* 
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grants are Reported to NSF as having been spent on 
the grants they were awarded for, not on the grant 
they were actually spent on. Therefore, although 
the 'total spent on two grants that were related 
would be accurate/ the actual, amount spent on 
each individual grant could not be determined. 
( See chapter 3 . ) 

THE NSF EXPERIMENT NgEDS TO BE / 
BETTER MANAGED AND EVALUATED 

NSF*'s monitoring of its experiment raised a number 
of concerns. NSF started the Master Grant phase 
without reviewing the existing u-niversity prior 
approval systems, or how thetee systems exercised 
the grant administrative authorities that wer-e 
deTegated to them prior to the ^experiment . GAO 
found that NSF did not closelj^. monitor the uni- • 
versities* use of the master grant authorities and 
did not always adequately inform the universities 
of changes, modifications, etc., to the experiment. 

NSF expanded the experiment to Phase II without 
conducting all of the evaluations planned for the 
Master Grant phase. Although the OPAS remained the 
>Sl^y feature of the experiment, NSF did not evaluate 
the adequacy of the existing QPASs at the partici- ^ 
pating universities before expanding the OPAS au-- 
thorities to all grants at the universities. At 
the time o'f our review, NSF did not have a formal 
plan to evaluate Phase II of the experiment.- 
(See chapter ^4.) . ^'*^->' 

RECOMMENDATIONS - 

The Director of NSF should require that: 

— Each university's OPAS include an Official 
independent of the participating departinents 
who can ass\ire that each department is exer- 
cising the delegated authorities properly an<3 
who has or has available the (scientific exper- 
tise j^cessary to review and approve actions. 

— NSF review eacH university ' s CJ^AS to assure 
that the university h*as estabi:ished a system . 

• that can act responsibly before any delegation , 
of prior apprbval authorities is made. 

— Applicable NSF^regulations or grant agreements 
explicitly provide that the authority to approve 
pre-award costs c^innot/ impose an obligation on 
the Uni^ted States prior to the availability of 
'appropriat^ions . ^ 
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— NS^ develop a Phase II evaluation plan and 
assure that the necessary resources are 
available to carry it out. The evaluation 
should include a thorough review of elch 
university's OPAS policies) procedures, and 
actions, and be, performed by official (s) 
independent of those managing the experiments 

— NSF closely monitor the universities' use of 
the experiment * s authorities and promptly 
provide the universities with information on 
changes, modifications, etc., to the experi- 
ment. 

In addition, GAO makes several recomii\endations to 
the Director, NSF, detailing how .acco^untability for 
OPAS actions can be improved. * ( See chapter 5.) 

AGENCY CO MMENTS 
• — ^ 

NSF and 0MB generally concurred with GAO's conclu- 
sion that the experiment has important potential- 
benefits for the future administration of Federal, 
research grant funds. NSF agreed with' or planned 
to Consider most'^of GAO*s recommendations. N^ 
provided information contrary to that previously 
given to GAO which affected two recommendations. 

The recommendation regarding special grant conditi 
originally required that each university provide in-^ 
formation to NSF to allow it to monitor these con^i- 
ti^ons. It has been revised to . allow OPASs to be re-^ 
sponsible for assuring that special grant conditions 
are not violated. The recommendation requires" that 
NSF assure that each participating university is 
aware of its responsibilities. The recon\mendati,on 
requiring WSF to provide adequate audit coverage 
, return the responsibility to the cogni*S(ant audit 
agencies was deleted. since NSF informed GAO that ^ 
cog)iizant audit agencie? concerned have the respon- 
sibility. ^ 

0MB* s comments clarified its position on the re- 
latedness concept's effect on accountability. 
(See appendixes I and II.) 
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CHAPTER 1 

.introducti6n' 



Most federally funded basic research is carried out in our - 
Nation's colLeges and universities. Recently, these institu- 
tions have become increasingly critical of the Federal system 
'**^X>^or assuring accountability for the funds allocated to them. 
^ "Universities have argued that Federal rules tend to' limit their 
flexibility in managin^\£^esearch funds and have an eroding 
effect on the creativi^ vdtal to the research process. Federal 
offici'als have, in turn, atgued that these rules are necessary 
to^^assure that Federal%Wds are spent in accordance with the, 
terms of the rese^irch agreements, withou»t fraud or waste. Some 
of the organizations involved include the Na^:ional Science Foun- 
dation (NSF) , the National Institutes of Health, the Office of 
Management and Budaet (OMB), and us, as well as university 
administrators and \researchers , and members of Congress. 

- . In January 1976, NSF, in collaboration with th^^ Association 
of American Univer^ties, undertook an experiment in grant 
administration designed to respond to the perceived needs of 
universities for flexibility while assuring appropriate finan- 
cial accountability. NSF discussed the hattire ,of the experiment 
with OMB, some congressional staffs, us, and others before under- 
taking it.« The primary '^jectives of the experiment are to: 
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— increas-e economy and efficiency of research p;-ojects 
supported Ijy NSF through increased sharing of resources 
a-^ greater authority for local decisionmaking; 

... 
— reduce paperwork associated with administering 

' . ' ' Federal grant programs.; and 

— improve accountability for expenditures of public ^funds 
by carefully defining the universities* responsibilities 
and providing standards^ for decisionmaking. 

BACKGROUND • • ' - 

The National Science Foundation is an independent Federal 
a#e^(^^efi^blished under the National Science Foundation Act of 
1950, as amended (42 U.S>C. 1861 et seq. ) 1970- Its primary 
migg^on l5 t*^ i^ t- 1 » :*n . jn">« nn' n. R . rriar^nf^ by finpportina basic 
research and science education. NSF fulfills this responsibility 
in part by sponsoring scientific research at educational insti- 
tutions. Traditionally, it has used grants to support basic 
tesearch. 

Although individual ^ researchers propose and conduct the 
research, NSF grants are normally made to a university, known ^ 
as the grantee.. NSF agrees to provide full or partial financial 
support for the costs of the research to be performed and the 

o . ■ ■ • 1 ^3 
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grantee agrees to perforin the research, prudently manage the 
funds provided in the grant, and carry out the provisions of 
the* grant award. 

NSF's Division of Gr.ants and Contracts is responsible for 
assuring that any proposed grant is consistent with applicable 
policies, regulations, directives, and fund certifications. • 
The grants 6ffice,r is the only NSF official with delegated 
authority to issue grant letterd and to obligate NSF funds for, 
expenditCires under ^grants . . ^ 

NSF progra'm officers are the key personnel in the scien- 
tifici^teclirjological directorajLes who review, evaluate, and 
reconun^nd proposals for grants, monitor the scientific aspects 
of grants, and review requests for changes in grant direction 
or management and for rebudgeting. The program officers approve 
all requests for administrative *and budget changes except where 
decisions are reserved to the grants officers. 

While NSP generally has not been significantly involved in 
conducting or managing the research on individual projects, NSF*s 
grantees must follow certain grant administration requirements 
that are mandated for all .recipients of Federal research grant 
funds. NSF grantees are required to have financial management 
systems that meet the requirements of 0MB Circular A-110. The 
circular and its attachments provide the Fe'detal policies and 
procedures governing Federal agencies' administration of grants 
to educational institutions. In addition^ expenditures under 
NSF grants are governed by the Federal cost principles applicable 
> to instiMtions of higher education contained in 0MB Circular 
A-21. ^ 

Under the current research support system, many researchers 
receive support for thei^^esearch in multiple, discrete grant 
awards of limited duration. 0MB guidelines require these re- 
searchers to accouYit separately for each grant. This accounting 
constraint may lead *to cost transfers (a researcher transfers 
costs from one grant to ano^th^r), especial ly' when' a .researcher • s 
overall research program is funded by several sources — some 
costs may be legitimately assigned to more than one source. 
Sometimes a researcher needs to make some legitimate but retro- 
active reallocation of charges, resulting' in cost transfers* 
An award notice trhat arrives late' can also lead to cost trans- 
fers since a Uni!versity sometimes uses other funds to begin a 
grant t o avoid delays" or interruptions, in the research. After 

LUe award riO Llce ciirivea. Lh e unTvnrnit-_y nn( XA.- tir>ict\' 4- r^nc ^f 

to allocate the costs to the appropriate grants. 

0MB guidelines severely limit using cost transfers and . 
require explicit documentation. ' If tibe cost transfers are not 
well documented/ they may be disallowed. Universities believe 
such documentation is quite burdensome, limits their flexibility 
to manage research funds, and has an eroding effect on the 
creativity vital to the research process. 



THE EXPERIMENT IN RESEARCH 
GRANT ADMINISTRATION 

The experiment in research grant administration (herein- 
after referred to a^s the experiment) i-s testing the feasibility 
of allowing universities greater flexibility to administer NSF 
research grants after the grants have been awarded, and is also 
testing ways to facilitate universities' and researchers' 
accounting for costs iricu^ed on their research grants. 

I^The experiment' i^divided into two phases. Phase I, called 
the Master Grant phase, involved grants awarded tey NSF's Chem- 
istry Division *to the chemistry departments of nine universi- ^ 
ties. J./ The 9 departments each had 2 master grants, for a 
total of 18 master grants incorporating 245 individual grants^ 
with an awai;d value of almost $34 million. Existing NSF ch^~ 
istry awards to each department became the first master grant. ^ 
As NSF approved new chemis'try awards during the Master Grant 
phase, they became part of the second master grant. New master-^ 
grants were needed' at 2-year intervals because NSF has 2-year 
appropriations. Phase II, which started in January^ 1981 , ex- 
panded the experiment to include almost all NSF grants awarded 
to the ''nine original participating universities, plus three 
additional universities. 2/ .The 12 Phase II universities had 
3,746 N5F grants with an award value of* $540 million. 

'The experiment differs in two key aspects from NSF's 
standard administration system which is used for all NSF grants 
not included in the experiment. *(We compare the standard and 
experimental post-award policies ^nd procedures in appendix III.) 
First, under^tlhie experiment, most of the authority to .review 
and approve post-award grant administrative and budget changes 
has been delegated to each university's organizational prior 
approval system (OPAS) instead of to the NSF grants officers and 
progratn officers. The organizational prior approval system is 
the university management mechanism that enables the university 
to use the authorities delegated by NSF'^t-o review and approve 
changes in the administrative and* budget details of a grant or 
grants under. the master grant (e.g., grant. budget changes, exten- 
sions of time, purchase of research equipment, etc.). Use of the 
OPAS for review and approval is supposed to eliminate the flow 
of individual requests back and ^ forth between the university and 
NSF and the resulting delays in decisionmaking. ^ 



1/The University of California at Los Angeles, the University of 
CalifojEJiia at San Diego, the California Institute o f. Technology , 
the University of Wisconsin at Madison, the University of 
Illinois at Urbana-Champaign , Cqlumbia University, the State 
University of New York at Stony Brook, Massachusetts Institute 
•of Technology, and the University of Florida. 

2/Princeton University, Stanford University, and Yale University. 



The additional- approval authority d'elegat^d by NSF gave 
participating -universities the ability to rebudget grant funds, 
acquire special' purpose equipment, approve foreign travel, 
charge grants for pre-award costs incurred 'at the risk of the 
universities,' extend the performance period of the grant, 
transfer funds' iDetween' research grants, and make several other 
grant administrative changes. , 

^ N^F viewed the delegation of the additional authority^, as 
a low-r-isk situation at, the participating universities^ since 
theV already had prion approval systems in place and^ince the4-, 
additional^ authority .Applied only to the master gran^^awards . 
The participating universities had prior approval systems "in 
place because 'in 1977, NSF delegated authority to approve four 
types of tebudgeting actions to any university which , established 
a prior- ap^oval system (see page 63). NSF also viewed OPAS 
(approval as^'^ar'Cw^y to -maintain (or possibly ^incrgifeise ) grant fund 
accountability by defining the universities' responsibilities 
and pr.pviding standards for decisionmaking while reducing Federal 
intrusion and paperwork in the administration of NSF's research 
grants ht the. universities.. ^ 

The s^econd key aspect of the experiment, introducing the 
concept s-'^of , aggregation and relatedrjess , was designed to give the 
universities^.and researchers more flexibility in the use of grfint< 
funds. ,The aggregation concept, used in the Master Grant phase,* 
grouped grants together under one master grani^.t; for administrative 
purpose^ ,^'^and allowed the transfer of ^unds between grants in 
each master grant. In Phase ll, relatedness replaced aggregation. 
The relatedness concept permits researchers to allocate costs 
amohg tHeir individual NSF grants, o pro;/ided the grajnts are scien- 
tificaMy or technically related. The Phase II rej^tedness con- 
cept differs -from the aggregation concept in that it eliminates . 
the need to group individual awards into master grants and it 
requires »de*termining scientific relatedness. 

OBJECTIVES^ 'scope, AND M E THODOLOGY 

the increasing concern for how Federal research 
grafnt rfurtfls ^are administered and the experiment's potential 
efcect on 'accounting for these funds, w^ reviewed the experiment 
in research. grant administration to assess whether the Master 
Grant phase met: its objectives, the status of Phase II of the 
experiment, NSF ' s' evaluation of the Master Grant phase and its 
plans to evaluate Phase II . One congressional committee and 
four subcommittees have, expressed an interest in our review of the 
eiperiment'^ the Senate Committee on Go<^ernmental Affairs and its 
Subcommittee on Federal Expenditures, Research and Rules; the 
Subcbmmittee' on HUD-Independent Agencies, Senate Committee on 
Apprqpf iations ; the Subcommittee on Science, Research and Tech- 
nology, Hoyse Comifiittee on Science and Technology^; and the Sub-, 
committee on Intergovernmental Relations and Human Resources, 
House Committee on Government Operations. 



This review was performed in accordan.ce with our; "Standards 
for Audit of Governmental Organizations, Programs, Activities,, 
and Functions." Of the nine universities participating in the 
Master Grant phase of the experiment, we selected seven,!/ to 
to review their- use of the experinjfent * s authorities. The cri- 
terion for this selection was that: they were located in GAO 
regions 2/ that Ha^ at least two universities participating in 
the experiment in order ta maximize the use of our resources. 
The two universities ^that were not reviewed did not differ mark- 
edly in terms of the amount or number of grants inv9tLvfed in the 
experiment. We reviewed- all 163 Master Grant ph^se actions 
taken by the se3:ected universities during the experiment's first 
23 months that required one of the newly delegated authorities. 
We interviewed 81 researchers who had us^d the Master Grant 
authorities and were available to talk to us, 8 department 
chairmen ( 1 • university had- 2 different chairmen during the Master 
Grant phase), and 21 university administrators. We al^o inter- 
viewed NSF officials in the Office of Audit atid Oversight, 
Division of Grants and Contracts-, and the Chemistry Division, 
and officials at the Office *of Management and Budget. In addi- 
tion, we interviewed officials at the audit agencies responsible 
for auditing the participating universities: the Department of 
Health and Human Services* Inspector General ' s' Of f ice , and the 
Contract 'Audit Agency of the D^artment of Defense. 

, In addition, we selected a sample of NSF <g^^:ants that were 
awarded prior to the experiment to the universities included in 
our review to compare selected aspects of NSF's standard adminis- 
tration system to the Master Grant experimental system. We 
requested the grant files for all awards from the Chemistry 
Division to the chemifetry departments of the, seven universities 
in pur review that were active during the 6-month period prior to 
the Master Grant phase. These-grants were eventually included in 
the experiment or completed before the experiment began. NSF 
provided a list of 166 grants that were active in that period, but 
said manf of the records were already in storage and would take 
several weeks to obtain. To avoid delays, we asked NSF to provide 
readily available fi]^s, and NSF provided 48. We have no reason 
to believe that this* is not a representative sample since it con- 
tains alrftost one-third of the universe^ and the selection process 
was limited only by the location of the files. 



l/The University of California dt Los Angeles, the University 
of California at San Diego, the California Institute of Tech- 
nology, the University of Wisconsin at Madison, the University 
of Illinois at Urbana-Champaign , Columbia University, and the 
State University of New York at Stony Brook. 

2/The 49 continental States are divided into 15 GAO r^egions, 
each having at least one regional office. 





Five of the seven universities included in our review had 
entered Phase**II while we were still doing field work, so we 
9btained information on how -they were implementing Phas^ II, 
although we did not review .any Phase II action^. NSF provided 
some information on how the other universities planned to imple- 
ment Phase II and we obtained additional i^iformation by calling 
the universities. 

0 

0MB SUPPORTS THE EXPgftlMENT 

0MB officials said expenditures for related * fe^search grants 
are consistent with 0MB circulars on grant administration. The 
officials said the form of a grant is determined by the grantor 
agency. So, if two grants ^re maddr and are subsequently deter- 
mined to be related, the r^earcher has, for administrative p'ur- 
poses, one grant. However,^ 0MB does not require the related 
grants to be combined into .one grant. For example, grant A funds 
can be spent for allowable costs of , grant B (provided A and B 
are-scientif ieally related) but wij.1 be reported to the grantor 
agency as having been spent on grant A. This is how NSF i<s . 
handing financial reporting for Phase II. 

T5mb officials said that the peer review' system will assure 
the scientific integrity of related research grants. For ex- 
ample, suppose a researcher Jhas at. biology grant and a physics 
grant that are related and that researcher spends "tx^l the biology 
grant funds on the. physics grant. The expenditures woulcl »be re-* 
ported as the amounts awarded for each grant, which obviously 
limits financial accountability for these grants. The officials 
said . the control over expenditures for xelated grants will be 
the peer review system. For the example above, if the researcher, 
did not do any work on the biology grant, Ke or she probably 
would not haye been aftjl^ to publish any research papers on it, 
and therefore, presumably, the peer review system would not 
award any further grants on this topic to the researcher. The 

ficials said that the peer review system assures that there 
is scientific integrity for the individual grants even though, 
from a financial perspective, there will be none on an individual 
basis when grants are related (because costs can be charged 
and recorded against a different grant than the one they we^ 
incurred for) . v.^'fe 
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0MB officials praised the experiment's attempt to deal with 
the problem of allocating a researcher's time and effort amc^ng 
basic research grants. 0MB regulations require a researcher to 
report the time and effort spent on each grant. The officials 
recognized that a researcher with two or more grants for basic 
research is usually working in a single field of sc4ence but 
the current grant award system separates that researcher's 
research into discrete grants. 0MB officials informed us that 
they do not believe it is necessary to maintain individual grant 
records for research grants that are scientifically related. 
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CHAPTER 2 



MASTER GRAl^T PHASE IMPROVED 
RESEARCH GRANT ADMINISTRATION 



Because the Organizational Prior .Approval System (OPAS) 
is the mechanism the universities use to review and approve 
changes in the administrative management details of ,a grant, 
the OPAS has becdme the key to the experiment in research 
grant administration. Each university had an OPAS to exercise 
the newly delegated powers and assure proper accountability 
over NSF grant funds. 



OPAS POLICIES >AND PROCEDURES 

The OPAS structures at the seven universities we reviewed 
are of two general types, those which include an independent 
review of OPAS actions outside the chemistry department (multi- 
layer) and those where approval occoVs solely in the chemistry 
department (single layer). Four universities included an 
independent review outside the chemistry department, for example 
the grants and contracts office, or the office of sponsored 
research, or both. The department chairman was the first layer 
of review in each of these syst!ems except for one university, » 
where, the first layer Was a committee of the department- chairman 

;and two chemistry faqul^ members. ^ 

• * ■ t 

Two universities had the department Jcha^rman act as the 
sole reviewing and approving official for most of the delegated ' 
authorities. One university was%wnique' in that it required 
three lay^ers for about one-half of the autViorities and only 
one layer, the department chairma,n, for the other half. \J NSF 
required that the three universities that had the department 
chairman as the sole approving authority , provide adSitional' 
review and approval for those actions which involve the 
chairman's grants. 

Four universities had restrictions or special conditions' 
beyond the requirements of the master grant agreement with NSF. 
One university agreed to participate only after it was able 
Jto assure its researchers, that they would retain control over 
their individual grant funds and that aggregation would only 
take place in reporting transactions to NSF, i.e., the aggrega- 
tion concept would not be used to transfer funds between grants. 
One university •chemistry department chairman did not allow fund 
transfers or foreign, travel requests to be approved by the OPAS. 
One uni\/ersiH:y required A researcher who wanted to use the pre- 
award feature t^o assure the university that if the award was 
not made the university would not be liable for costs incurred. 



1/This university was grouped with the single layer OPASs since- 
" over 70 percent of the OPAS actions were approved by the 
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Although this requirement w^s not enforced for two subsequent 
pre-award approvals, the department chairman said in both of 
these cases assurance was obtained from an NSF offidial that 
once the university receives verbal notification of the pending 
award no risk would be involved in th-ese pre~award approvals. 
Anothe-r uRiiyersity had a system which limited t-he .effect o^f 
the master gjtants since it was already providing the chemistry 
department with many of the master grant features, such as pro- 
viding funds for pre~award costs and funding gaps. 

The master grant agreements requirec^^Jihat the universities 
send a summary of OPAS actions to NSF on a periodic basis. Five 
of the universities fulfilled this requirement. One university 
only sent summaries for 10 of its*14 actions while another uni- 
versity had sent copies of 9 of its 12 actions. 

MASTER GRANT . DELEGATED AUTHORITIES 



An OPAS action occurs when a researcher requests OPAS appro- 
val to use a delegated authority. For example, 'if a researcher 
wants to rebudget salary funds to purchase a piece of equipment, 
he initiates an OPAS action explaining what he wants to do and 
why. The- written request and the OPAS approval or denial con- 
stitute an -OPAS action. The authorities delegated to the OPAS 
and a brief desrt'iption of what each authori^ty allows the re- . 
^ searcher (tJi:;^ OPAS to do are listed in table 1. 

• » 

Approval of actions by OPAS • 

We reviewed every action taken by the OPASs^*at the seven 
universitie/S we reviewed that exercised the newly delegated . 
master grant authorities.. The number and types of actions? 
approved by each university's OPAS are listed in table 2* 
No actions' were disapproved. 

Approximately 60 percent of the researchers who had grants 
under the master grants used one of the master grant authorities 
at least once.* The percentage of researchers at the universities 
who*used the master grant authorities ranged from a low of 17 
percent to a high of 77 percent. • . 

The frequency of actions per grant taken under the Master 
Grant phase of the experiment, either by type or total, did not 
differ significantly as a result of delegating the approval 
authorities to the universities from what it was when NSF was 
reviewing such actions. We compared the number and frequency 
of OPAS actions to the number and frequency of NSF-approved 
actions taken on the sample of grants that were not in the 
exj^eriment and^which used the standard system. Only four of the 
nine master grant authorities could be cqmpared since the parti- 
cipating universities used only six of the nine master grant 
authorities and two of those (fund transfers and pre-award) were 
^ not previously allowed under the standard system. The results 
' .are listed in table 3. 

♦ V 
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Table 1 



Authorities Delegated To Universities 
By Master Grant Agreements "a7 



Authority 



Fund transfers 
(new authority) 



Pre-award costs 
(new authority) 

No-cost extensions 



University OPAS May : 

Transfer funds provided under 
a master grant among grants 
included within the master grant; 
,reprogram' funds between, line 
items of the aggregated master 
grant budget . 

Incur costs up to 90 days' 
prior to award date. 

Extend expiration -date of any 
girant under a /naster grant for 
up to 6 months . 



Rebudgeting for 

— Special* and general 
purpose equipment 

— Foreign travel 



-Contracting project 
efforts 



-Alterations and 
renovation 



Purchase special or general 
purpose eqi;i.ipment • ^ 

Approve foreign travel for a 
researcher and dependents. 

Contract part of a grant's 
effort after an awaxd has 
been made.) 

i 

Approve alterations, and 
renovation costs up to 
$10,000 to adapt space or 
utilities within a completed 
structure to accomplish tlie 
objective of NSF-siipported 
activities. - 



' — News releasee cost 

— Commercial production or 
distribution of grant 
materials 



Approve news release costs. 

Approve the commercial 
production or distribution 
of materials produced under 
a master grant . 



a/These authorities require prior approval before the action 
is taken. As in the standard administration system, only 
actions/expenditures not provided for in the award document 
need to be approved. 



Table 2 ^ 

OPAS Actions Requiring Newly Delegated 
Master Grant Authorities 



J 



Univer- Equip- Pre- Foreign No-cost Prbject 
ment --award Travel Extension Effort 



- sity 
A 
B 

c 

D 
E 
8-F 
' G 
Total 



23 
17 
16 
si 3 
5 
7 

84 



7 
2 
14 
4 
4 
3 
_2 
36 



5 
9 
1 
3 
3 
1 
_2 
24 



4 
0 

0 

1 
1 

• 

1 

8 



1 

2 

0 

1 

0 

0 

0" 

4 



Fund ' 
Trans- 


Total 


1 


38 


3 


37 


1 


32 


1 


22 


>. 1 


' 14 


0 


12 


' 0 


8 


7 


163 



Table 3 

Comparison of the Frequency 
Type of Actions Between Experiment a'l 



and Standard Systems 

. ; , — . ■ r 

Experimental System 
Number Percent 



Equipment | ♦ '84 

Foreign travkl 24 

No-cost extension 8 

i 

Contracting project 
j).effort , 4 

Total ! 120 



70.0 ' 
20.0 
6.7 ' 

3.3 



100.0 



Standard Sys tem \ 
Number Percent f 



\ 



18 
8 

1 

_2 
29 



62.1 
27.6 
. 3.4 

6.9 
100.0 
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There were 120 actions taken on the 201 grants unde'r the 
master grants which averaged 0,6 actions per grant. The sample 
actions from the standard'^sysitem also averaged 0.6 actions per , 
grant All OPAS actions' were approved, and 28 of the 29 samt>le 
actions were approved. 

Aggregation c oncept, used very little 

The aggregation concept was not used very much, v except to 
report grant expenditures on an aggregated basis, becVuse accord- 
ing to university officials, many researchers were ^reluctant to 
Intermingle their research funds with those of other researchers, 
and the OPAS delegations for pre-award costs and. no-cost exten-' 
sions eliminated many situations where transfers between grants 
might haVe t^ken place. 

* 

The fund transfer authority was designed to increase the 
sharing of resources. However, the universities made little 
use of the aggregation concept to transfer funds between grantrs 
under a master grant. 

University officials said there were several reasons why 
there was little use of the aggregation feature to transfer 
funds. The chemistry department cha*irman at one university did 
not believe aggregation should be used because experienced re- 
searchers might exploit the less experienced researchers and 
becaqjse deficiencies in the university's accounting system made 
using the aggregation concept risky. Officials at another uni- 
versity said they expected to have more fund transfers but not 
until /the end of the master grant. A third university made three 
fund transfers ($2,129, $1,033, and $8) when the donor grants 
wer^e /completed or nearing completion and unexpended funds re- 
mained. Officials from three universities said researchers were 
reluctant to intermingle their funds with other researchers' 
funds*^ ^ ^ 

i 

Official^ from one university said the OPAS delegations for 
.pr'e-award costs and no-cost extensions eliminated many of the 
situations where transfers were necessary since both features 
extend the performance period of the grant ^nd were used to 
minimize funding gaps. 

RESEARCH GRANT ECONOMY AND 
EFFICIENCY INCREASE UNDER THE 
MA STER GRANT PHASE 

' One objective of the experiment is to increase the economy 
andv efficiency of research projects by delegating greater author- 
ity for grant administration decisionmaking to the universities. 
Over 78 percent of the researchers interviewed who had used the 
OPAS believed it generally increased the economy and efficiency 
of their research. Researchers indicated that (1) the time and 
effort necessary to obtain approval of requests was reduced, (2) 
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the pre-award feature pi^ovided the abilitylto begin work oa gr*ants 
more promptly and effiaiently, and (3) local university ^^roVal^ 
increased their ability to respond flexibly i to changing ^fant 
needs. Thirteen researchers with 15 OPAS actions cited specific 
benef±*ts <they attributed t:o local DPAS approval, such as ^'aving 
money'. In axJdition, although it is difficult to measure /; there 
were indicators that on'e of the benefits of the Master Grant 
.phase was improved morale. - 



OPAS provided faster approval 



Over 67 percent of the researchers who had used the OPAS 
indicated that itf'reduced the length of time required f or ^^p- J 
proval of their requested OPAS actions. *RfesearcherS noted< that f 
under the standard system a letter must be sent the NSi^ pro- ^ 
grhm officer, which necessitated setting up a correspondence 
file, and sometimes \send ing follow-up letters. TQiey note($ that 
the local OPA^ avoided the Federal bureaucratic processino and 
eliminated mail delays. ^ I 



y 

We identified six actions where, according to the research- 
ers, fast OPAS approval made a\ signif icant conti;ibut ion tb the 
research grant. For example, o^e researcher received OPAS ap- 
proval in 8 days to purchase research equipment not p^revio'usly 
included in the budget. He said the equipment was vital to a 
major scientific discovery made by a postdoctoral student^ who 
was leaving soon. He said deLay in approval Could have meant ; 
losing the student before re<reiving the, equipment, causing the 
research to suffer immensely. ' 

^ ' % ■ . 

Three researchers said fast OPAS approval resulted i^rf saving 
money. For example, one researcher said OPAS approval in*3 days 
avoided a price increase on a laser purchase which saved approxi- 
mately $10,000. Anothe?: researcher said he received OPAS approval 
in 6 days to purchase a. replacement spectrophotometer whi^h 
avoided a 10 percent price increase, saving $3,820. 

We reviewed the time needed for OPAS approval at the seven 
universities. Data on d^ates of request and approval were^avail- 
able for only 125 of the 163 OPAS actions. The approvals ranged 
from the same day to 28 days and averaged 5.2 days for all OPAS 
actions. Data were available for 19 of the 29 actions iniour 
sample of the NSF grants under the standard system. The approvals 
ranged from 6 to 35' days and avenged 15.4 days. Since it takes 
a minimum of another 2 to 3 days before the universities receive 
written notification of NSF approval, we believe OPAS approval is 
at least 12 days faster than the standard system. Table 4 lists 
the Results of the comparison between OPAS approval times and NSF 
approval times under the standard system. 
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Table 4 



Comparison 




Master Gpant 


OPAS 


wi th 






NSF Approval Times 












Average 
(days ) 


Ra nge 
Tdays). 


NSF Approved 


19 




is 


.4 ■ - 


6-35 


OPAS Approved 


125 




5 


.2 




' University A 


37 


^/ 


2 


1 

.5 


i-a 


University B 


f 

A 


SI. 


3 


.3 


1-9 • 


University C 


32 


( 


6 


.9 


1-28 


University D 


22 




5 


.6 


1-22 


University E 


10 




9 


.0 


1-27- 


University 


12 




2 


.5 


1-8 


* 

University G 


8 




10 


.0 


1-21 
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a/Data available for 19 of 29 actions. 

b/Data available for 37 of 38 actions. 

' ' c/Data availably for 4 of 37 actions — the OPAS form did not 

require dates for when action was requested and when' 
it was approved . 

d/Data available for 10 of 14 actions. ^ 

Pre-award costs allow grants 

to start mbre promptl y ' ' • 

Seventy-five percent of the researcher^ Atfko^j^j^d^he pre- 
award feature said the economy and effici^fic^ of th^3&^ research 
increased because the pre-award feature provided the ability to 
start work on grants more promptly. The researchers said it 
. allowed them to order equipment and hire personnel in advance of 
the start dat^ of their research grants which helped to maximize 
the amount of research that could be done during the grant period. 
They also said the pre-award authority serves as a bridge for 
funding gaps which cqbld occur between grants. Two researchers 
said the pre-award authority enabled then? to keep their research 
groups together by providing salary funds or accounts to charge 
so that the research groups did not have to be disbanded when 
funding gaps occurred. / 



We found five actions where, according to the researchers, 
specific benefits resulted from the use of the pre-award feature. 
For example, one researcher said he used the pre-award authority 
to synchrorvi^ th^ptiming of an equipment purchase which required 
a delivery time of 3 iTionths with the employment of a foreign p'ost-* 
doctoral s^tudent who was. scheduled to return home 7 months after 
•the start of the qrant period. The reseaArcher said he used the 
pre-award authority to have the equipment available at the start 
of the g±ant period. .The researcher said the pre-award authority 
had a multiplier effect since the student was able to use the 
equipment for the full 7 months an^ train four other researchers 
in the group to use the .equipment . Another researcher said h« » 
used the pre-award authority to purchase a piece of equipment 
before a, higher price became^ effective , saving nearly $5,000. 

OPAS increases ability to ^ 
r espond to grant need s- 

_ ^ ^ ^ 

^ Almost 54 percent of the resea'rchers who, had used the OPAS 
mentioned that the OPAS approval mechanism increased thieir ability 
to respond flexibly to changing grant needs. Several researchers 
noted that it is difficult to accurately predict the n^eds of . 
their research, effort in ^ grant proposal submitted months before 
^the start of a grant. The OPAS gives a researcher the ability to 
reallocate his or her resources through various budget chances. 
Requests for. new research equipment or. urgent travel can be^ap- 
proved quickly by the OPAS. The OPAS authority .to approve a no- 
cost time extension to continue research helped several research- 
ers. For example', at one university, four no-cost extensions were 
approved. In two of the four actions, although funds remained in 
the old grant and a new grant waa pending, a 'gap bet\feen the expi-» 
ration of the old and the beginning of the new would have inter- 
rupted the continuity of the , research. The no-cost extensions 
bridged the gap by allowing the researcher to continue working 
using the funds remaining in the old grant. 

We found four actions where, according to the researchers, 
the OPAS actions provided increased' timeliness and/or^lexibility' 
that appeared greater than under the standard system.' For ex- 
ample/ one researcher discovered that his laboratory water was . 
too impure to. be used in Jiis laser cooling system. Since the 
laser could not be used without the cooling system, the researcher 
said it was essential to his research that* the purchase of a 
purification system be c^pproved quickly. Our statistics showed 
an average NSF appCDval time of approximately 2-1/2 weeks. OPAS - 
approval was 'received the same day as the request. 

GRANT PHASE PAPERWORK 



The experiment's second objective is to reduce paperwork 
associated with the administration of Federal grant programs. 
The Master Grant phase thad little effect on^ paperwork at the 
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universities because QPAS actions still need to be documented 
to assure' accountability. However/ the experiment did reduce 
the jf*low of ^paper between the universities and NSF since grant 
administrative* changes are now approved by the universities* 
OPASs instead pf NSF. At NSF, the Master Grant phase increased ' 
paperwork since it required identifying and converting existing 
awards from the standard system to the experimental system and 
it required a new administrative system overlaying the standard 
system. Some of this additional effort was a one-time cost due 
to the changes. 

» 

Although 29 percent of the researchers b^ieved their paper- 
work had decreased/ over 70 percent believed there had been no 
change in paperwork and none believed there had been an increase. 
The department chairmen were evenly split on the paperwork 
question--50 percent believed it had increased and 50 percent 
believed there had been no change. x ,Over 66 percent of the OPAS 
administrators sai4 there was no^change in paperwork. About 19 
percent > said there was an increase because they are now review- 
ing and approving OPAS actions. Two administrators pointed out 
that the increase was more than offset hy thef t>enef its . Several^ 
NSF Chemi^stry Division program officers noted a slight reduction 
in their paperwork because they no longer had to approve most 
grant administrative changes. • * 

. 'The M/ister Grant phase did reduce some financial reporting , 
paperwork. Financial reporting of grant, expenditures on the 
Federal Cash Transaction Reports was reduCeif f rom a line entry 
foe each grant to a single line entry for each master grant. 
However, 'the universities still kept individual financial grant 
records because the research&rs need this information to manage 
their expenditures and to help develop budget estimates for 
future grant proposals. 

ADSQuATt: CONTROLS NEH£)ED » 
FOR ACCOUNTABILITY; 

The experiment's third objective sought to improve accoun- 
tability for the expenditures of public funds by carefully defin- 
ing the universities* responsibilities and providing standards 
for decisionmaking. We identified severajL areas where better 
controls are needed to assure adequate accountability. We found 
'that OPASs with a review layer independent of the chemistry 
department^ provided better accountahil:^;^ for OPAS actions 'than 
OPASs consisting of only the chemistry *epartment chairman/ that 
the (documentation requirements for OPAS actions varied/ and that 
actions requiring prior approval were approved retroactively. 
In addition, if NSF decisions* to award funds for a giv^n scope 
of work are circumvented by doing work in other areas # accounta- 
bility will be affected. ' - 
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\ OPASs with an independent review layer 
prpyAder^better accountability 

* « 

Our review of OPAS actions at the four universities with a . 
review layer which was independent of the chemistry department 
found that at three of the" universities the , independent layer(s) 
of review questioned certain actions. Consequently, the actions 
were modified to provide additional documentation or additional 
review Was performed to assure that the action was properly 
explained and documented. For example, at one university 3 of 
the 14 actions were modified primarily as a result of questions 
raised by a university-wide official who revie\yed the request 
after the department chairman had approved them. Another offi- 
cial who also reviewed all OPAS actions said there had been one 
* or two instances where 0^>AS requests were returned by him for 
clarification of the- request or to provide further support. 
After the^ changes were made, the actions were approved. 

Our review of the OPAS ^actions at the four universities ^ 
with a review layer independent of the chemistry department did 
not identify any major problems; however, we did find problems 
at two of the three universities with single layer OPASs. At 
two universities we found that department chairmen approved 
their own requests to rebudget funds to purchase research equip- 
ment. At both schools, the master grant agreement required that 
the department chairman's request be approved by another univer- 
sity official. One department chairman approved his own request 
to purchase $50,000 of computer-related equipment. Univfersit^. 
officials aclcnowledged that the request should have been appr,oved 
by another university official. The other department chairman 
approved his own request to rebudget $2,425 from salaries to 
equipment. The chairman said he was not aware that the master 
grant agreement required a subsequent review by another univer- 
sity official. , . V 

One univer-sity with a single layer OPAS presents a vivid 
contrast to the multi-layer systems discussed above.. The depart- 
ment chairman said he does not review OPAS requests for scien- 
tific propriety, research relevance, or policy permissibility and 
that he has never denied a researcher's request. The chairman's 
la;fi:)^^of, concern 'with OPAS actions is emphasized by his designa- 
tion of an administrative staff person as an alternative official 
to^^approve OPAS I requests . In one case involviji^a foreign travel 
acticm, the chairman admitted that he would not have approved 
an action approved by the administrative staff person had he 
reviewed it. 

The director of this university's office which has respon- 
sibility for administering all research grants awarded to the 
university admitted his initial hesitancy in agreeing to place 
all master grant approval authorities at the department level. 
He said it could have some benefits in that it forces the depart- 
ment- to tajce responsibility for its action. However, he said he 
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was disturbed by the lack of a university-wide perspective. 
To insure 'such perspective, he intends to put his office back 
into the OPAS structure for Phase II cfitf the experiments 

Documenting OPAS ^ctiolhs varies 

Documenting^PAS actions is an important means of assuring 
accountability (for NSF research grant fun^s. The documented 
actions proyide\evidence that permits a determination that 
applicable policies and procedures have been followed in exer- 
cising the c^glTegated authorities. According to the masteir grant 
agreements /Ithe OPAS is intended to assure that there are ade- 
quate university reviews and approvals of decision^ made which 
affect' the ^management of grants. The agreements require these 
decisions and the review and approval of them to be documented. 
However, the docum"ei::^ation required by these agreements varied. 

Four of the seven agreements required the document^atibn to 
•include a description of the decision being made and the scien- 
tific ^ technical/ and/or administrative reasons for it. The other 
three'agreCTients only required that the documentation include a 
description of the decision being made. All seven agreements re- 
quired that the docuinentation show^ that it has been reviewed for 
scientific or technical need and propriety, research relevance, 
effective Utilization of institutional resources, policy permis- 
sibility, and' fund availability. 

We reviewed all 163 OPAS decisions (actions) ^to determine 
if the documentation provided sufficient Information to allow 
for an independent review to determine if applicable policies 
and procedures have been followed in exercising OPAS authorities. 
We believe that a 'description of the action and the scientific, 
technical, or administrative reason for the action is essential 
i:o allow -such a review. As shown' on table 5, most of the OPAS 
actions provided this inforijation even though the reas6n was not 
required to be documented at three universities. It is not pos- 
sible to review the remaining OPAS actions to determine if appli- 
cable policies and procedures have been followed because the rea- 
son for the action was not documented* We believe that to allow 
for* an independent review of OPAS acti>Qns, the documentation 
should include* a description of the action And the scientific, 
technical or administrative reasort for it. In addition, NSF, 
which reserves the right to withdraw a university's delegated 
prior approval authorities if the^J^niversity mismanages thfem, 
will not be ahXe to determine'^lf the^Uniy^ersity mismanages the 
authorities if "rthe reason^ Tf&frt.he actions "are. rjot documented* 
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Table 5 



Documenting OPAS Actions 





Number 


Description 


Reason 








^rTOVluea 


Provided 


SIFR a/ 


A 


1. Q 
O O 


Jo 


24 


22 


o 


"^7 
O / 




34 


34 


'• c 


32 


32 


31 


31 


• D 


22-^ 


22 


22 


17 


E 


14 • 


14 


12 


11 


F 


' 12 


11 


8 • 


4 


G 


8 


% 8 


7 


_7 


Tottfl 


163 


162 


138 


• 

126 



a/siFR:^ sufficient information for review — to permit an 
effective OPAS* review of scientific or technical 'need and 
propriety, research relevance/ effective utilization of 
institutional resources, policy permissibility, and fund 
availability. 

Retr oac t i ve appr o va 1 s 
could hurt accouiitabTlity 

^ The qPAS is designed to assure that the delegated author- 
ities are exercised properly. The master grant agreements re- 
quired the OPASs to approve a researcher's request before an 
action is taken. When actions are ap^oved after they have 
already been made, the system has failed' to function properly 
and accountability could suffer. We found six actions requiring 
prior* approval that were retroactJ?v'ely approved. 

^ ' / 
* TJiree retroactive approvals were for pre-award costs. The. 
retroactively approved pre-award costs appeared to have the 
objective* of transferring costs between grants for reasons of 
convenience, which is prohibited by th^ Federal cost principles. 
For example, costs that had been charged to an expired NSF, grant 
in one master 'grant were transferred to a new NSF grant in a 
different master grant by retroactively approving the request 
to. incur pre-a.ward costs on the new grant. The researcher had 
a grant under the 1978 master grant which was to expire, on 
February 29, 1980. He was awarded a new grant under the 1979 
master gJrarit with an effective date of November 15, 1979. On 
Ded^ember 12, 1979, the OPAS approved his request to incur pre- 
award costs on his new grant which had started on November 15. 

18 



) < 

The researcher's request stated "Costs incurred [$11,408] on 
[the 1978 master grant] must be transferred to its renewal award 
[the 1979 master grant] because of a gap in finding." However, 
as the dates above show, there was no gap in grant funding^ and 
the r^equest to incur pre-award costs came after the new grant's 
starting date. University officials said that the request should 
have gone to NSF for approval because it involved costs that had 
already been incurred. 

The remaining three retroactively approved OPAS actions were 
X^equests for reimbursing costs already incuri'ed for foreign travel. 
For example, one researcher requested approval to pay for a post- 
doctoral student's travel from his previous place of residence to 
the university. There appears to be no reason why this action 
should not have been requested prior to the trip. However, another 
researcher's request for reimbursement of foreign travel costs 
seemed reasonable even if it was approved retroactively. The re- 
searcher went to England to work with another scientist on research 
being supported by NSF. The other scientist had a grant that paid ^, 
for the researchei::^ .air travel and some of his living expenses. 
Since his cost;s exceeded what the other grant could pay for, the 
researcher asked for reimbursement of his living expenses in Eng- 
land after he returned to the university. The OPAS documentation 
noted that a s imilar . request for travel, was made in October 1978 
and approved by NSF. The documentation also noted that approval • 
would have been given if the request had been made prior to the 
trip. V 

In additiQn, delegating authority' to the OPAS to approve 
pre-award costs could have implications under the Anti-Deficiency 
Act (31 U.S.C. 66 5)* which ^prohibits agencies from incurring ob- 
ligations in advance of appropriations. As noted previously, 
pre-award costs, to be allowable under the experiment, must have 
been incurred within the 90-day period immediately preceding the 
effective date of the grant. If a particular award were made at 
the beginping of a fiscal year, the preceding 90-day period could 
include-^me time bSfore the new appropriation became available. 
To preclude possible Anti-Deficiency Act problems, applicable 
NSF regulations 03t the grant agreements should make it clear that 
the approval process cannot impose an obligation on the United 
States prior to the availability of an appropriation to fund the 
costs. See 56 Comp. Gen. 31 (1976) • 

Scientific accountability 

NSF said pre-award scientific accountability will probably 
not be afifected by the experiment because 'it does not change the 
wa;/ proposals are submitted, re\riewed, and funded by NSF through 
the peer review process. However, NSF has not determined what 
the universities • •responsibilities for po>t-award scientific ac- 
countability should be. We identified one concern during our 
review which could affect post-award scientific accountability. 
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Accountability will be affected if NSF's decisions to award 
funds for a certain scope^of work are changed by researchers who 
end up doing work in other areas. The relatively small size of 
most OPAS actions make it unlikely that any changed a grant's 
work scope. However, several OPAS actions on the same grant 
could have a cumulative effect that might affect the grant's 
work scope. 

For example, at one university, after several consecutive 
budget change requests for equipment purchases had been approved 
for one grant, the university-wide layer of the OPAS questioned 
a further request for another rebudgeting action to purchase 
equipment because it believed the cumulative effect of all these 
requests might have changed the direction of the research. 
The OPAS consulted with the chairman and they decided to ask 
the researcher to solicit NSF*s opinion on these changes. NSF. 
had no problems with the changes and the OPAS approved them. 
At another university, the OPAS specifically reviews the 'actions' 
effect on a grant's scope when the reiquested change is in an 
area reserved for NSF approval. For example, the university 
considers a change of time expenditures approaching 25 percent 
of the amount budgeted as having a possible impact on the scope 
of work. The university would send these requests to NSF for 
their approval. 

Our review of OPAS actions found only one grant where a 
researcher had rebudgeted over 25 percent of his grant funds* 
The researcher rebudgeted 32 t 3 percent of his funds to purchase 
equipment. We believe having to re)jort all cumulative OPAS 
actions that exceed 25 percent of a grant's budget is warranted 
by the increased accountability provided when NSF reviews these 
actions . 
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CHAPTER 3 
PHASE II E XP ANSION 



Phase >il both expands and modifies the Master Grant phase. 
Phase II expands the prior approval authorities delegated to the 
OP AS fropT the^ chemistry department to all university research de- 
partments h^ing NS? grants. Phase II modifies the experiment by 
substituting the concept of relatedness for aggregation. The ag- 
gregation concept grouped grants together under one master grant 
for administrative purposes because they were awarded by NSF's 
Chemistry Division to a university* s "chemistry department. The 
relatedness concept allows funds to be committed' or expended from 
a research grant for allowable costs incurred on otl\er scientif- 
ically related grants, 

« 

The OPAS remains the key feature of the experiment and its 
functions become even more critical in Phase II. The OPA^ will 
continue to review and approve researchers I requests to assure 
that delegated authorities are exercised properly. In addition, 
the OPAS is responsible for reviewing and approving requests to 
relate research grants. This additional responsibility will 
require the OPASs to have the scientific expertise ne'c^essary to 
review and approve requests to relate research grants. • 

RATIONALE FOR CHANGE TO PHASE ,11 

NSF decided tc^ expand to Ph\se II on the^ basis of informa- 
tion it developed during the fir^ fey month#of the experiment. 
NSF decided that while tfhe resultV-JW^re encouraging there was 
a need to introduce some basic changes in the experiment .\ The 
changes NSF identified included the need tb reconsider the use 
of the master g^ant mechanism and the aggregation concept. 

NSF officials said the master grant mechanism was too cum- 
bersome administratively within NSF. An NSF official noted that 
«ie master grants required a new system overlaying the standard 
system, required more effort anfl paper processing, and caused 
significant problems identifying and converting existing awards, 
and that it was difficult for NSF's Management Information System 
to accommodate the changes. Because of these problems, expansion 
of ^he experiment to other NSF program areas was considered doubt 
ful. 

NSF^ of ficials found that there had not been many fund trans- 
fers under the aggregation feature of the- master ■ gr^ant . They sai 
that the ^delegated authorities'^or pre-award costs and no-cost ex 
tensions reduced the number of gaps' in funding which eliminated 
many of the situations where they expected fund transfers to be 
usea. An NSF Official added that the 2-year award period for 
master grants limited fund transfers between grants since funds 
could not be transferred between master grants. 
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Also, some concern was expressed" within NSP about the aggregation 
concept, which was viewed as giving too much flexibility in using 
grant funds among otherwise unrelated grants • 

NSF officials also said the relatedn^ss concept offered bene- 
fits beyond the aggregation concept,^ They noted that aggregation 
focused on all researchers in a dep^^ment that had a grant from 
the Chemistry Division. NSF discovered that most audit except-ion^ 
for cost transfers usually involved individual researchers with f 
multiple grants. Aggregation^ could not help many of these re- 
searcher^ because their grants were from different NSF divisions 
and/or other Federal agencies. Therefore, NSF believed ^that by |. 
shifting from aggregation, to scientific relatedness the experiment 
could reduce many of the present problems associated with audit 
disallowances for cost transfers between a researcher's related 
grants, , Xn NSF official said that the relatedness concept is an 
attempt to resolve some of the time and effort reporting problems 
universities are having implementing revised 0MB Circular A-21,^ 
He said relatedness should have a positive effect on resolving 
* r'esearchers * problems in allocating their time among related 
research grants • 

Additionally, NSF officials believed »the concept could 
eventually be used for related grants awarded by other Federal 
agencies. An NSF official said relateohess can be used on an 
interagency basis as long as the restrictions involved in main- 
taining separate congressional apprppriation accounts are main- 
taihed.' , L 

THE RELATEDNESS CONCEPT 

Although NSF has not specifically 'defined relate^ess, it 
developed parameters which an OPAS cah use to help-^^Setermine 
^ "commonality of research," i.e., the circumstanc^ under which 
the scopes of' two or more grpints can be regarded as a single 
scope for research management purposes, NSF Genial Grant 
Conditions for Phase Ilpprovide the following epcamples: (1) 
the theor'etical approaches of grants are related, (2) studies 
of the same phenomena are conducted by the same or different 
techniques; studies of different phenomena are conducted by 
the same techniques, and (3) specific instrumentation, which is 
central to the work being performed, is used. We believe the 
OPAS must have the scientific expertise necessary to review and 
approve requests to ^relate rese^arch grants 
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Once two or more grants are related, funds may be committed 
or expended from one grant for alJ.owable costs incurred on other 
related grants during the grant period. An NSF official said that 
some grants may be excluded from using the relatedness concept. 
He s€^id these exclusions would be determined jointly by NSF pro- 
gram and grants officials.* 

The OPAS makes the only determination of relatedness if an 
individual researcher wants to relate two or more NSF grants. If 
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two or more researcher^s want fto relate their grants, the OPAS has 
to approve the request and the approved request must then be sent 
to NSP*s Division of Grants and Contracts. That division discusses 
the request with the cognizant NSF program officers • NSF approval 
is automatic if it does not reject the request within 30 days after 
receipt . 

Reporting expenditures for 
related research grants 

Researchers are required to report expenditures for each NSF 
grant on the Federal Cash Transac±.ion Report (discussed on page 
•65). For two grants which are determined to be scientifically re- 
lated, expendittires from the funds of one grant to assist another, 
grant are reported to NSF as having been charged to the assisting 
grant. In other words, expenditures made for related research ^ 
grants are reported to NSF as having been spent on the grants they 
were awarded for, not on the grants they were actually spent on. 
Although the total spent on the related grants would be accurate, 
the actual amount spent on each individual grant could not be de- 
termined. Therefore, under tyjie relatedness concept, there will be 
some loss of financial accountability for individual grants that 
are scientifically related. For example, suppose a researcher has 
two $50,000 NSF grants, A and B. If the researcher related the 
grants and spent $5,000 of grant A funds to buy a piece of equip- 
ment for grant B, he or she still repqrts the funds as having been 
spent on grant A. 

IMPLEMENTING PHASE II AT^^THE UNIVERSITIES 

The nine universities participating in the Master Grant phase 
expanded to Phase II by June 1, 1981. In addition, three other 
universities entered the experiment beginning with Phase II* The^ 
number of departments with NSF grants and the number of researchers 
with two or more NSF grants are listed in table 6* 

« • 

PHASE II OPAS STRUCTURES 

The Phase II OPASs varied slighty from the master grant OPASs 
at the five Master Grant phase participants that had expanded to 
Phase II while we were still reviewing the master grants. FoutJj of 
the universities had multi-layer OPASs and one had a single layer 
OPAS.^ At least one of the three additional Phase 11 participants 
is experimenting with a different OPAS structure. 

y 

Multi-layer OPAS / 

• \ 

Three of the multi-layer OPAS universitiJes plan to use, 
with some slight variations, the same mqlti-layer OPAS structure 
and procedures as used in the Master Grant phase. The depart- 
ment chairmen will review> relatel3ness requests for scientific 
propriety. Once relcftedness has been determined, a researcher 
can allocate , costs to either grant without further OPAS approval. 
However, relatedness is not a blanket ^authority and .researchers 
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Profile of Phase II Universities 



University 

Master Grant 
Participants 



Entered 
Phase II 



1/1/81 
2/1/81 
3/1/81 
3/1/81 
3/1/81 
3/1/81 
4/1/81 
6/1/81 
6/^1/81 

New^ Participants , 

10) Princetoii 1/1/81 

11) Stanford \ 3/1/81 

12) Yale 3/1/81 



No. of University 
Departments with 
NSF Grants • 



No. of Researchers 
with Two or More 
NSF Grants 



1) 


A 


2) 


E 


3) 


D 


4) 


C 


5) 


G 


6) 


H 


7) 


I 


8) 


B 


9) 


F 



a^/University was -^^mT^ included in our review — da\ta not readily 
available. 

b/NSF*s Office of Audit and Oversight "Report on Audit and 
Oversight AAU-NSF Experiment in Grant Administration/ 
0A0-81-H66, June 29, 1981. 
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42 
37 



41 
28 
30 
15 
71 

9 b/ 
52 ^/ 
41 
33 



20 b/ 
46 b/ 
26 b/ 



^ated authorities 
purchases over 



will have to obtain OP AS approval for those delejt 
deeding prior approval. For example, equipment 
$1/000 not approved in either related ^rant budgjet require OPAS 
approval*. 

Two of the three universities' chemistry departments plan to 
keep separate accounts for each individual grant's relatedness ex- 
pendit,ures to maintain accountability for internal qse. Other de- 
partments at th6se universities had not determined alt the tim^ of 
our review how they would account for expenditures'' among related 
grants . ^ y 

The 'fourth multi-layer; OPAS university that expanded to Phase 
II plans to us*e two systems. Departments with three; oi^ more ac- 
tive NSF grants woulcj use the Master Grant phase system. Depart- 
ments witl^less than three NSF grants will be allowed to , use a 
less formA^system/ i.e./ they can use just the department chair- 
man instead of ^ committee for the first layer o£ review or they 
may combine with another department. The two university-wide 
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lay^s will still review and approve all requests. As at the 
other three universities, once relatedness has been determined, 
researchers can allocate costs to either grant without further 
OPAS approval as long as the specific action does not otherwise 
require prior approval. 

A university official said individual grant expenditure ^ 
records ^wi'll still be maintained, although they may not be accu- 
rate on an individual basis because of expenditures foif related, 
grants. The official noted that the aggregate records should be 
correct. JFor example, a researcher may initially estimate spend- 
ing 20 percent of his or her time on grant A and. 30 percent on 
grant B, whereas the percentage may actually be reversed. If the 
researcher relates the grants, no adjustment is needed for the 
variance 'of actual to projected time since the tptal effort on 
the two related grants is still 50 percent. However, he stated 
that expenditures for each individual grant will be misstated, 
but this becomes moot sinc6 under the relatedness concept the 
focus is on the total expenditures of both grants. 

This s^me university official said a researcher who has 
related a grant to another researcher's grant may nevertheless 
want to know which expenditures have directly benefited his or 
her own portion 6f the related research. However, he pointef3 
out that this individual grant focus is ct>ntrary to the spirit 
of the relatedness concept. As a result, any such records will 
have to be maintained by the researcher since it will not be 
provided by the univers-ity * s accounting system. 

Single .layer OPAS 

The university with th^B single layer OPAS structure that ex- 
panded to Phase II while we were reviewing the Master Grant phase 
plans to use two OPAS structures to implement Phase II. Depart- 
ments will be assigned to either Type* I or Type II structures 
based on (1) departmental resources for administration, (2) NSF 
grant volume, and (3) administrative experience. Type I depart- 
ments will follow the master grant OPAS procedures, i.e., only 
the department chairman's approval will be required for most 
authorities. Type II departments will have actions approved by 
both the department chairman and the university's director of 
grants and contracts. In addition, an administrative staff per- 
son will review all requests after they have been approved. 

This university plans to handle expenditures for related 
grants differently from the- other ^four tmi irrr^i t i , Ennh -f^-- 
penditure for" related research grants must be approved by the 
OPAS on a transaction by transaction basis. A university offi- 
cial said relatedness must be determined ^ased on each requested 
action. For ejcample, just because two grants were related to 
enable a researcher to purchase a piece of equipment for one 
grant does not mean that the grants are related for other types> 
of expenditures. As a result, each OPAS request must be evalu- 
ated separately. At the other universities, once two grants are 
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related, the grants are treated as if their scopes of work aire 
combined. Therefore, expenditures may be allocated to either^ 
grant without an OPAS request. A university 'of ficial said that 
a researcher may request that type of relatedness, i.e., where 
the work scopes are combined, but he does not expect it to hap- 
pen very often. The official said the researcher would have to 
provide a very detailed explanation to have that type of related- 
ness approved. , ^ - ^ 

This university is also experimehting with th^ documenta- 
tion of *its Phase II OPAS actions. The , university and NSF 
agreed that trie documentation of OPAS reviews required by NSF 
policy may be construed-to consist of the identification of 
the decision and signatures of responsible officia*ls certifying 
that J^e request has been reviewed for all NSF requirements. 
University documents, note: ^' 

t 

"...the review depends on a communication, betwveen 
the [researcher] and those whpse ^ii>proval is re- 
quired, which identifies t;he proposed action and 
the reasons for it. This communication need not 
be written, but the documentation of the review 
must certify th$it the... basic review criteria 
have been responsibly considered. The review » 
will also involve reference to the grant account^ 
and grant file." * 

Therefore, the documentation of this university's OPAS^ actions 

does not have to contain the reason for the action. 

% 

Additional Phase II participants^ , 

OPAS structures * ■ '\ 

NSF was not sure of the OPAS structures at two of the three 
additional Phase II participants even after the experiment's au- 
thorities had been delegated to the participants. ' An NSF official 
said that one and perhaps two universities ^ only involved in Phase 
II are experimenting with another typ6 of OPAS structure^ one that 
does not include the department chairman^ At one of these univer- 
sities, the OPA? consists 'of a single official, independent of the 
scientific departments, who is responsible for reviewing and ap- 
proving OPAS actions. The NSF official ,said that ^of f icihls at the 
second university were discussing eliminating the department chair- 
men from their OPAS and having a structure similvar to the one just 
discussed. The official said he would not know for sure until the 
university sent copies of its OPAS actions to NSF (the genere^l 
gr^nt conditions for Phase II do not require NSF approval of OPAS; 
in fact, they do not require the universities to send a description 
of the OPAS to NSF). 

. An ^NSF official said the third ^university involved only in 
Ehase II is using a multi-layer structure including the depart- 
ment chairmen and at least c5n^ official independent of the scien- 
tific department. The official said that although he dde-s not 
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know the exact nature of the OPAS structure, he has ^ssured him- 
self that each of the additional universities has a p^son who is 
knowledgeable about the experiment arid NSF ' s goals. 

RESEARCHERS ' AND ADMINISTRATORS 
REACTIONS' TO PHASE II . ' 

Researchers' reactions to the expansi9n to Phase II were 
mixed. Most researchers who responded to our questions about 
the relatedness concept said they would consider using it. One 
^of the major advantages cited by researchers was that related- 
ness allows them to allocate costs among related grants which 
many believed would reduce the need to transfer costs. Re- 
searchers also noted that the relatedness concept could promote 
sharing of resources, equipment, arid personnel, and that it 
provides a mechanism to keep research going during funding gaps. 

Several researchers had concerns about the relatedness con- 
cept. One department chairman sa'id he would not approve related- 
ness requests because he believes there is potential for senior 
researchers to pressure junior researchers and that researchers 
with grants in a deficit position would use relatedness to erad- 
icate the deficit. Researchers at three universities felt that 
relatedness could be a threat to the competitive nature of the 
individual research grant system. These researchers said they 
preferred to be judged on their own merits and that would be 
difficult' if they related their grants. 

Several administrators saw promise in the Phase II expansion. 
They said significant^ benefits would accrue to a researcher with 
two or more NSF grants, particularly in reducing the potential for 
costly audit disallowances. The administrators added that ques- 
tionable cost transfers will be eliminated when grants are related. 
They also said that adjustments for variances in time devoted to 
each of two related grants will not be needed if the total effort 
chargeable to both grants is the same as originally projected. 
One administrator noted that lifting the Master Grant phase re- 
striction that funds could not be transferred between master 
grants would facilitate interactions among researchers. Another 
administrator was not as Enthusiastic, however. He sa'id Phase II 
would significantly increase the university's responsibilities, 
drain administrative resources, and that it might be difficult to 
maintain- r^asonabl^ control. Several administrators s^aid they did 
not expect many requests to relate grants . 
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CHAPTER 4 



T,HE NSF EXPERIM E NT NE fePS TO BE 
BETTER MANAGED AND EVALUATED 



/ • . 

Achieving success in an experiment raquires good management 
and evaluation. Good management keeps the experiment on course 
towaird As goals- Proper evaluation begins with-- designing the 
experiment and determining its goals in measurable terms; estab- 
lishing criteria fot success, including some basis for comparison 
such as evaluation of existing conditions against which to measure 
changes fostered by the experiment; and establishing an indepen-- 
dent evalua'tion team to monitor and assess results of the experi- 
ment • 

Our review of NSF*s monitoring of its experiment raised a 
number of concerns. NSF started the Master Grant phas§ without 
reviewing the e'xisting university prior approval, systems . It did 
not monitor the experiment as well as it could have and started 
Phase II of the experiment without completing the evaluations of 
the Master Grant phase universities or the master grant OPASs. 
AlsO/ at the time of ou.r review, NSF did not have an evaluation 
plan foryPhase II of the experiment. 



PRIOR APPROVAL SYSTEMS IN EFFECT 



BEFORE MASTER GRANTS NOT REVIE WED 

NSF said there was little risk in delegating p'rior approval 
authorities to the universities participating in the Master ^ 
Grant phase because the universities already had prior approval 
systems in place and the delegated authorities applied only to 
NSF Chemistry Division grants. In 1977, NSF delegated four grant 
administrative authorities to all NSF grantees provided that they 
establish an organi^zational prior approval system. Actions on 
grants needing the delegated authorities required prior approval 
before costs resulting from the actions could be charged to NSF 
grants.^ The four types ,of actions were (1) alterations and reno- 
vation^ under $1,000, (2) cumulative expenditures for equipment 
which exceeded budget amounts by more than 25 percent, (3) cumu- 
lative domestic travel expenditures which exceeded J.25 percent 
of amount budgeted, or $500, whichever was, greater, and (4) hiring 
consultants rtot already budgeted in the grant. The prior approval 
systems were required to review researchers * requests for actions 
using the same criteria the future master grant OPAS would use. / 
However, WSF did not review how well these delegated authorities 
were used before beginning the experiment. 

The three universities with single-layer master grant OPASs 
each removed at least one official (layer) from the pre-master 
grant X)PASs that had provided a review of the actions independent 
of thw scientific departments requesting the' actions and that 
provided a university-wide perspective. One university's master 
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grant OPAS eliminated two layers of review, f,rom the e^xisting 
prior approval systems, h university official said the two layers 
r.eviewfed each action for scientific propriety, technical need, 
and agency and university policy requirements,' In addition, 
one of the two eliminated layers reviewed the grant document 
to de^ermne if there were any restrictions on the funds awarded*. 
The official said that after several years of experience, one 
layer reviewed all requests and the other layer reviewed only 
requests that were denied. The $>fficial said the reviews 
conducted -by these two layers were delegated to thi^^epart- 
ment chairman in the master grant OPAS bu't noted that ^ .person 
in one of the ^temoved layers reviews every OPAS action to assure 
it complies with university and NSF reqi^irements . The other two 
universities eliminated layers that reviewed for compliance with 
NSF^and university policy requirement^^,;^^ 

NSF DID NOT CLOSELY MONITOR 
THE EXPERIMENT 

Evidence indicates that NSF did not closely monitor .the 
experiment. According to one NSF official, oversight and moni- 
toring activities included meetings with other NSF officials, 
and site visits to many of the participating institutions to 
obtain information useful in conducting and evaluating the V 
experiment. The official said site visits were a significant 
factor in the- decision , to move to Phase II and to add otl^r 
institutions to the, experiment . However, as discussed hWlow , 
we found a number of problems with the way NSF carried out its 
monitoring role. 

Accountability problems 

at one university not- identified 

Financial accountability for Federal research grants 
• administers^ undeo: one university's Master Gra^rit experiment we 
examined is deficient. In part, this problem emanates from 
accounting system inadequacies that predated the Master Grant* 
experiment. The uni^versity * s implementation of the experiment, 
including the OPAS structure, operations, and documentation, have 
added to these deficiencies. 

The university ' s^aster grant OPAS eliminated the review 
level with a university-wide perspective in its existing prior 
approval system. The univer»sity "grants of f ice'*^' was part of 
the existing prior approval system. Its review included an 
analysis Qf the OPAS action iri light of the agency's reporting 
and other requirements, A^ dis*cussed earlier, the chemistry 
department chairman, who was given this responsibility in the 
masteir grant OPAS, said he does not review requests for sci- 
entific propriety^ research relevance, or poli<:y permissibility 
because to do so would be an insult to the researcher. The - - 
chairman also designated an administrative staff person &s 
his official alternate. He told thi,s staff person 't6 put total 
confi-cl^nce in fihe researcher's justifications when reviewing 
requests • Ik ' 



The potential negative effect on grant accountability 
caused by this limited OPAS review is demonstrated by the follow 
ing .four actions approved .by the university's master grant OPAS. 
The chairman approved his own OPAS request, without subsequent 
review^ which was prohibited by the master grant agreement. 
The prior approval system approved a pre-award request, retro- 
actively^ which is contrary to the master grant agreements. Al- 
though the chairman is opposed to using OPAS to approve foreign 
travel requests, one was approved by his alternate. Thel3PAS's 
failure to properly review a request, indeed its disregard for' 
critically reviewing OPAS requests, may havfe resulted in a vio- 
lation of a special grant condition (3ee p. 31) . 

The lack of documentation of OPAS actions also weakened 
financial accountability. Four of the 12 actions did not 
indicate the scientific reason for the request. Eight of the 
12 did not contain sufficient information to, permit a proper 
review. The OPAS review and approval was documented by the 
official certifying that he had reviewed the request. However, 
the university's certification did not indicate that all neces- 
sary reviews had been made. It states that "[the] re<t3uest 
has been reviewed with respect to scientific considerations 
and to NSF and University policies and is approved." There 
is no evidence that any review was made for effective utiliza- 
tion of institutional resources or fund availability as was 
required by the master grant agreement. 

The mastl^r grant was superimposed on a deficient account- 
ing^ system. The chairman said there always have been problems 
in assuring accountability for grant funds. He said his staff 
reported that the university controller's office is 6 to -7 
months behind in charging purchase orders against grants. The 
system's lack qf expenditure controls often permits grants to 
be charged costs in excess of budgeted amounts. For example, 
two grants under the master grants which had been expired for 
nearly a year each had a deficit in excess of $25,000. As a 
result of thq lack of expenditure controls, the chairman be- 
lieves neither he nor the researchers could assure financial 
accountability. Weaknesses in the accounting system are further 
demonstrated by the university's failure to adjust grant budgets 
for many approved OPAS actions. Revised grant Ipudgets are not 
normally processed for most OPAS actions. 

We 'found that these deficiencies in the university's 
implementation of^^e master grant authorities offered sig- 
nificant potenti)al for weakening financial accountability for 
research grant funds. Perhaps most serious is the superficial 
review given OPAS actions by the chairman and his alternates. 
The lack of a subsequent levej. of review further cont|ributes 
to the incomplete assessment of OPAS requests. Without a 
university-wide official reviewing these requests, NSF and 
uniyersity policy considerations are given little attention., 
.Beca^use of the deficiencies jat this university combined with* 
the preexisting accounting s*ystem weaknesses,* there is little 
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assurance that grant funds are being properly accounted for and 
expended for authorized purpdses. ^^^y^ 

NSF officials in charge of the experiment did not plan to 
conduct an indepth review"^of the university's use of the master 
grant authorities or the prior approval system before Expanding 
to Phase II, even though the Director -of the Office of Audit and 
Oversight ^aid in a February 1980 memorandum that he opposed 
"•..any extension of [the delegated authorities at this uni- 
versity] unless a very thorough review justifies placing more 
confidence in their handling of such matters than appears war- 
ranted at the present^ tiiyie." 

Special grant conditions 
were not monitored 

When NSF delegated the authorities to the universities, 
it delegated the responsibilities for monitoring special grant 
conditions to the OPASs. However, not all of the OPASs were 
aware of this responsibility. For example, one grant under a 
master grant had a special grant condition that mandated that 
specified funds in the equipment line item be used to purchase 
a laser ^system. An OPAS action was approved that used some of 
these funds to buy other equipment. *For unknown reasons, the 
.request was submitted to the OPAS twice. The first OPAS offi- 
cial, a designee for the department chairman, was not aware of 
the special grant .conditio^ and approved the* request. He said 
he did not review th^ award documents to determiae if granting 
the OPAS request would affeqt special grant conditions. The 
chairman's signatujTe^ appeared on th^ form for the second sub- 
mission of this request. ,The chairman said he was oyerseas 
at the time and approval was act,ually given by his administra- 
tive assistant. Nevertheless, he said he would have signed the 
request and not bothered to inquire into the re^searcher ' s prior 
equipment "purchases under the grant. 

Implementation of Phase II 'X 
needed better planning ' ' ^ 

NSF did not closely monitor the implementation of Bhase II. 
The expansion to Phase II was done without finalizing how to • 
administer individual grants under the terminated master grants. 
Items that still needed to be finalized, after 'Phase II had 
already begun*; in^cluded the expiration date of the individual 
grants that had been under the master grants and the adminis- 
tration of grants that were in surplus or deficit positions 
awaiting fund transfers. / * 

' Cammunication Ipetween NSF and ... * ^ 
universities could be improved 

Day-to-day communication between NSF and tiTe universities 
needs to be improved. Although NSF ^terminated the master grants 
With one university • s State , system onNdarch 1, 1981, university 



-Officials were unaware of this in early March 1981. Another 
example of the communication problem was a university's attempt 
to resolve a problem it had when the master grants were termi- 
nated* According to a university official, this university 
asked ^SF i£ it could continue the master grant format until 
the grants expired to ke^p paperwork and confusion to a minimum. 
However, NSF was not able to arrange this. The official then 
proposed extending the ending dates of all grants in the first 
master grant to November 1982 and allowing fund transfer actions 
on those grants. ,He said this would relieve a heavy administra- 
tive burden in final reporting and allow the university to com-- 
plete a number of planned fund transfer actions. ^The university 
official said it took 3 months to work out the details, but NSF 
agreed to this plan. The official said that even though there 
were some problems and confusion associated with the transfer 
in the chemistry department, the rest of the uhiversity, which 

was not under the Master Grant phase, did rjfbt have _a.ay_-^iriDbJLems 

with' the transition to Phase II. 

Another example oS^ the lack of communication between NSF 
and participating universities resulted in one university's 
not attempting any ftmd traiisfers. During a visit to discuss 
the proposed Phase 11, an NSF official gave incorirect informa-r 
tion to university officials. The NSF official had reviewed 
* a proposed fund transfer that two researchers had agreed to and 
noted. that the grants were' not related. University officials 
said, based on this interpretati9n, no more fund transfers would 
be attempted.* However, under the master grant authorities the 
grants did not have to be related, since they were included in 
the same master grant. 

MORE EVALUATION NEEDED . % , 

Some NSF review of the experiment has occbj^red. However, 
we believe that not enough has been done to provide needed re^~ 
^^iew. ^ " ' 

Master 'grant evaluations 
not completed prior to 
expanding to Phase I~ 

NSF expanded the master grant experiment to Phase II with 
only a very limited review of the Master Grant phase. The master 
grant agreements included evaluations to be conducted at the end 
of 6 months and again at the end of the first year. NSF conducted 
the' 6-month evaluation only foai: of the nine universities. The 
^valuation consisted of questionnaires that were completed anony- 
mously by 44 researchers, and discussions held ^with researchers, 
department chairmen, individuals having responsibility for review 
of transactions under the OPAS, accounting officials, and othe^ 
administrative support staff. Also, a limited review of documen- 
tation and other records pertinent to the experiment was made. 
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. The results of the 6-mohth evaluation were summarized by 
an NSF official as follows. Delegations of the prior approval 
authorities were used less than NSF expected in that. the univer- 
sities were conservative in using the additional flexibility 
the authorities provided, the greatest use of flexibility was 
fen purchasing equipment, and the, time savings on hiring and 
obtaining approvals for starting a grant were found to be 
important. The researchers ' concerns about being dominated or 
ripped off did not materialize — the prior approval systems 
required their . approval for changes af f ectii|g. them, cooperation 
among researghers was encouraged, and the researchers* commun- ^ 
ication with NSF program officers was apparently not reduced. 

The 6-month evaluation recomitiended that agreements be modi- 
fied to expand the OPAS delegation of authority feature to all 
departments at. the four universities included i/i the evaluation, 

npA hhft qniversities had demonstrated the ability to manage 
this activity properly and the OPAS delegations had produced 
significant efficiencies in grant management. The recommen- 
dation included the provision that this expansion would be mad^ 
only to the extent that the universities considered it feasible 
and that they would submit .modified OPAS descriptions to assure 
that appropriate controls were in place on a larger scale. 

The evaluation report also recommended expanding the > 
Master Grant experiment at chemistry departments to include 
all ^SF-funded grants, not just those from the chemistry 
division; expanding the fu 11 , experiment to the universiti'bs * 
engineering departmen-^^,; and including all NSF ga^ants to trye 
engineering departmeK(ts v In addition, the report* contained a« 
additional recommendation suggested by one of the members of 
the review team to exploi^e concepts of relatedness that could 
'provide research management, flexibility without the master grant 
concept of e^ggregation . Noxnimediate action was taken by NSF 
on any of .Wie specific recommendations. 

NSF did not conduct the 6-month evaluation at the remain- 
ing five schools and did not condoct any first-year evaluations 
at any of the nine schools. Accorci^ng to NSF officials, they 
did not complete the evaluation because they had determined 
that the master grant OPAS mechanisja w^s working, and if it 
worked for the chemistry departmen^is at four universities, itH^ 
would work everywhere else. " Also/ the first evaluation led 
NSF to develop information on the relatedness concept and the 
problems researchers encounter with allocating costs among' grants 

We assessed NSF * s ' 6-month evaluation and found the follow- 
ing pFoblems. First, NSF * s evaluation report noted tAt 6 months 
was not enough time to make an indepth evaluation of lach a com- 
plex experiment. Second, the evaluation was conducted by the 
team running the experiment. Third, the evaluation was based 
mostly on questionnaires and interviews. Fourth, only limited 
reviews were made of OPAS actions or of accounting records sup- 
porting chargesrto individual grants. NSF's evaluation report 



33 



r 



m 

noted that these reviews were essentially informal 'in nature, 
consisting primarily of discussions with university personnel 
and a cursory examination of the underlying records. 

Little evaluation of universities* 
OPASs prior to expan ding to Phase II 

Under the experiment, NSF delegated certain powers to the 
universities that ordinarily yould be exercised by NSF officials. • 
As a condition of NSF's delegation, universities were required 
tQ have OPASs to assure that the delegated powers were exercised 
properly. NSF viewed this as the way to maintain (or possibly 
increase) grant fund accountability while also reducing Federal 
intrusion and red tape related to NSF grants at the universities. 
The OPASs were the heart of the grant administration experiment 
since they exercised the newly delegated powers and were intended 
to assure proper accountability * over NSF grant funds. 

Given this, it would^eem that the most important aspept of 
any evaluation of the experiment would include a thorough review 
of the OPAS at each university participating in tthe experiment 
before the experiment was expanded at each university or expanded 
to other universities. In fact, before the expansiort to Phase II, 
the Director of NSF's Office of Audit and Oversight wrote to the 
NSF official responsible for the experiment that: "...a thorough 
review of demonstrated^ administrative responsibility is a sine 
qua non for any extension of the delegation o£ authority either 
to the current list of Master Grant institutions or to others." 

However, NSF did not conduct this type of evaluation and 
decided to expand to Phase II without evaluating, the adequacy 
of the existing OPASs at the universities . - Also, the three 
additional Phase II participants,/ which had 'no operational 
experience with the Master Grant phase of the experiment, were 
not reviewed to. determine if they could handle the experiment. 
Even after 3 months of parfticipation , the NSF official in charge 
of the experiment was not sure of the OPAS structures of two of 
the additional participants. 

Responsibility for audit , ^ 
of experiment's grants 

NSF's response to our draft report stated that NSF did not 
assume responsibility for the audit ^of all grants under the ex- 
periment and that this responsibility remains with the cognizant' 
audit agencies. Our draft report stated that NSF had assumed 
responsibility for the audit of all grants-under the experiment at 
the participating universities. This information was based on in- 
terviews with NSF officials where we were given information con- 
trary to NSF's current j)o'sition. NSF statements to us led us to 
believe that NSF had responsibility for auditing^ NSF grants at the 
institutions participating in the experiment. We do not object to 
the cognizant audit agencies having responsibility for auditing 
NSF grants at the participating institutions and have deleted our 
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draft recommendation in light of the addi tional^information NSF 
provided. tj^;. ' \ ^ *^ 

NSF review ofjexper imeht > 

>' 

In July 1980^, an NSF official noted that NSF did not have a 
formal plan tq evaluate the experiment at the nine universities- 
He said NSF would be conducting an audit and that NSF audit of- 
ficials were w'^rking on audit guidelines and the schedule for 
visits. He no,ted that each university's system would be evaluated 
before it* is given expanded OPA.S authorities; however, the ques- 
tion was how to do the evaluation. An NSF audit official provided 
us with a copy of^their aud^t guidelines and the dates visits 
were planned. 

In March 1981, an NSF official said that the planned audit 
was not an audit or an evaluation but an abbreviated review aimed 
at pres^enting information to , help .structure the future Phase II 
evalu^ion. Researchers were interviewed on the relatedness con- 
.cept and how they viewed the OPAS and the types^ of documentation 
OPAS required. NSF issued a report on the audit dated June 29, 
1981. The report said that reviews were conducted at eight of 
the master grant universities. The reporft said the reviews were 
limited primarily to examining the actions taken under the OPAS, 
documentation supporting these actions, and interviews with re- 
searchers and other grantee personnel to determine their views 
on the concept of the relatedness of research projects. The 
repart also contained some statements'* on the evaluation of Phase 
II. It stated that: 

^> ^ 

"[NSF] will make an evaluation *bf the results 
of Phase II after each institution has had 
significant exper ience^^^ The evaluation will 
be structured to include participation by NSF 
representatives from the Division oj^iGrants 
and Contracts, Office of Audit and Oversight, 
and the program offices to assure that all 
relevant elements of NSF have input since the 
evaloatiori could result in the development of 
new or revised N8F policies and procedures. 
In our opinion, ^he evaluation should be made 
before any decision is reached to apply any 
( new provisions to NSF grants at all qualified 
] colleges and universities. " 

Phase II began January 1, 1981. NSF officials said in 
March 1981 that they planned to develop a Phase II evaluation 
plan during the next 4 to 5 months. They said they expected 
their Phase II evaluation to begin sometime in fiscal year 1982. 
However, ^according to an NSF official, the Phase II evaluation 
plan h4d not been prepared at the time of our review. 
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The report on NSP * s audit provided the only, evaluation 
information on the experiment besides the report on the review 
performed at four universities a^ter 6 months under the Master 
Grant phase. While both reports contained useful information, 
neither showed that a thorough evaluation, conducted by persons 
not directly involved in the experiment, was done. For exarnple, 
neither report identified problems in the single-layer OPAS 
structure that we found. In fact, neither report indibated 
that the OPAS, which is the key to the experiment, was thoroughly 
evaluated. *^ In addition, while both reports indicated that some 
documentation for OPAS actions had been examined,, neither found 
the documentation problems we identified. With the change to 
'scientific relatedness and its potential for use by other Federal 
agencies, the OPAS and its documentation become even more critica 
for maintaining accountability for Federal research gran^ funds. 
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CHAPTER 5 
* - — — - ■ 

CONCLUSIONS AND RECOMMENDATIONS 

We believe the experiment can improve Federal-university 
relationships, increase the efficiency and economy of Federal 
research grant administration, reduce the flow of pappr between 
the universities and NSF, and pr^Dvide universities and research- 
ers more flexibility in the use of grant funds. Although we 
found some operational problems which could adversely affect the 
experiment's successive believe that with the changes suggested' 
in this report, the new approach to research grant administration 
employed in the experiment will have a beneficial effect on the 
future administration of Federal research grant funds. The 
cognizant congressional committees should be aware that there is 
a liij](iited los's of financial accountability for individual research 
grants when expenditures are made for related grants. We stress 
that the experiment ??ibuld not, be" expanded further until a thorough 
ev^aluation is d^ompleted, the results assessed,' and essential 
'improvements made. 

The experiment redirects the focus of research grant admin- 
istration from NSF to intJividual universities and researchers, 
reduces NSF involvement in grant administration, and recognizes 
the scientific relatedness of researchers* grants. The Phase II 
authority, which allows research grants to be related on a scien- 
tific basis, has the potential to increase further the economy 
and efficiency of research grant administration. Relatedness 
should make i^ easier for universities and researchers to account 
for costs among scientifically related grants and eliminate the 
need to make cost transfers between scientifically related grants. 
This should reduce problems caused by Federal auditors disallow- 
ing cos>t transfers • 

TH£, MASTER GRANT PHASE'S EFFECT 
ON RESEARCH GRANT ADMINISTRATION 

9 

We believe that the Master Grani: phase of the experiment 
met^ its objectives of increasing the efficiency and economy of 
research grants supported by NSF. Delegating more decision- 
making authority to the universities allowed researchers ^to 
manage their grants more efficiently and economically. Less 
time and effort was required to obtain changes in grant budgets, 
pre-award costs were permitted to allow grants to start more 
promptly and efficiently, and researchers were given the ability 
to respond flexibly at the local level to changing grant needs. 

The Master Grant phase had little effect on paperwork at 
the universities because OPAS actions still had to be documented 
to assure accountability. At NSF, paperwork increased since the ' 
master grants required a new administrative system overlaying 
the standard system, although some of this increase was probably 
a one-ti'me effect due to the experiment. However, the experi- 
ment did lead to some reductio^n in the flow of paper between the 
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'\iniversities and NSF since grant administrative changes are now 
reviewed and approvetJ by the ij|niversities * OPASs. 

The Master Grant phase did not meet its objective' of in- 
creasing accountability for Federal gxant; funds. We identified 
several areas where better- controls, are needed to assure ade- 
quate accountability. We found .thalt OPASs with a review layer 
independent of the research department initiating the request 
better assured that the actions were properly reviewed. We also 
found that documentation for some OPAS actions did not contain 
sufficient information to determine if applicable policies and 
procedures had been followed. 

Accountability will suffer if NSF decisions to award funds 
for a given scope of work are circumvented by researchers doing 
work in other areas, if grants with special grant conditions are 
not closely monitored to assure OPAS actions do not violate the 
special grant condition, and if OPASs approve actions after they 
Tiave already been taken. To preclude possible Anti-Deficiency 
Act problems, applicable NSF regulations or the grant agreements 
should make it clear that the approval' process cannot impose an 
obligation on the. United States prior to the availability of an 
appropriation to fund the costs. We believe these problems will* 
be applicable to Phase II of the experiment and we have made 
several recommendations which, if implemented, should help main- 
tain accountability for NSF research funds in the future. 

PHASE II HAS ADDITIONAL BENEFITS 

The Master Grant phase benefits ■ derived from delegatinq 
prior approval authorities for grant budget changes should con- 
tinue to accrue during Phase ll. The benefits of university 
approval of the pre-award costs should also continue. The local 
OPAS remains the key feature and it should continue to allow 
researchers to manage their NSF grants more efficiently and 

effectively. 
• 

* The new Phase II authority to charge expenditures to one 
grant that were incurred for another related research grant 
should provide additional benefits. Relating research grants 
will increase the researcher's flexibility in allocating costs 
among scientifically or .technically related grants. Being able 
to more easily allocate costs should decrease the need to make 
cost transfers between grants. Relatedness should, at a nfini- 
myxtn, eliminate nearly all cost transfers between related grants 
"""of an individual researcher. The effect of relatedness could 
be greater if two or more researchers begin to relate their 
grants.^ By eliminating many cost transfers and thereby reducing 
the audit resolution problems, the morale of the university ^ 
researchers and administrators might improve. The recognition 
of the interrelationship of a researcher's grants and the re- 
duction of the intrusion of Federal red tape could produce a 
better atmosphere for research. However, the benefits of the 
, Phase II relatedness concept should weighed against the limited 
lloss of financial accountability for Individual research grants. 
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Tv^o additional potential benefits of Phase II relatedness 
are also evident. The recently revised 0MB Circular A-21 has 
caused problems for universities attempting to implement the 
Circular's time and effort Reporting requirement. Relating 
research grants should reduce and possibly eliminate a re- 
searcher's problems in allocating time and effort between 
related grants. 

Relatedness could potentially be used by other Federal 
agencies in the future. An NSF official sd||ft it could be used 
on an interagency basis, as long as the restrictions involved 
in maintaining separate congressional appropriation accounts ' 
are maintained. While Federal agencies would continue to award 
funds on a discrete grant basis, the researcher would be. free 
to manage his or her research funds in the most economical and 
efficient manner. 

' CHANGES ARE NEEDED IN PHASE II * . 

TO IMPROVE THE EXPERIMENT 

We identified several problems in the experiment which, if 
corrected/ will help NSF to maintain the necessary accountabil- 
ity for Federal funds. Our four concerns are that (1) several 
OPAS structures either do not provide an independent level of 
review or may not provide the necessary scientific expertise, 
(2) the documentation of some OPAS actions will not provide the 
information needed to assure accountability, (3) NSF needs to 
improve its monitoring of the experiment, and (4) NSF needs to 
develop and implement as soon as possible an evaluation plan to 
be .performed by an independent team. 

An independent level of 

review and scientific expertise 

At least one university's Phase II OPAS structure does not 
include a review layer independent of the department initiating 
the request. To assure that each department is exercising the 
delegated authorities properly/ we believe the OPAS should in- 
clude an official independent of the department initiating the 
request . 

NSF requires tha^t all OPAS requests be reviewed for scien- 
tific, technical, and/or managerial need and propriety. At least 
one Pha^se II OPAS does not include the department chairman and 
n\ay not have the scientific expertise necessary to review OPAS 
requests. This expertise is critical for requests to relate re- 
search grants since approval depends on the scientific or tech- 
nical commonality of the' work. We believe that each OPAS should 
have or have available the expertise nec^essary to provide the 
scientific review that NSF requires. 



Adequate documentation of 
OPAS actions is essential 



Dociamentation of OPAS actions is an important njbans of .en- 
suring accountability for NSF grant funds. NSF is ^experimenting 
with requiring just the identification of the OPAS action and the 
signatures of the OPAS officials cer1;ifying that it has been re- 
viewed for NSF requirements. We believe that certification with- 
out documentation of the reason ^or the action is not adequate. 

The Master Grant phase allowed tlje documentation of OPAS 
review and approval at three universities to con-^ist of identify- 
ing the decision and showing that it has been reviewed for s'cien- 
tific or technical need ^^j^d propriety, research relevance , effec- 
tive utilization of institutional resources, policy -.permissibility, 
and fund availability. We found that when the scientific, techni- 
cal , or administrative reason for the action is , not documented, i 
it is impossible to review that action to determine if applicable', 
policies and procedures have been followed. Accountability could \ 
decrease since it would not be possible to determine if the action 
was appropriate. 

In addition, NSF has reserved the right to withdraw a univer- 
sity's delegated approval authorities if the university mismanages 
these authorities. In order to determine whether the universities 
have mismanaged the authorities NSF must be able to review the 
OPAS decisions, especially the reasons why they were made. This 
will not be possible if the reasons for OPAS actions are not docu- 
mented . ^ ' , 

Monitoring th e experiment 

NSF needs to do a better job of monitoring the experiment/ 
The systems universities use to exercise the newly delegated 
powers which were intended to assure proper accountability over 
NSF grant funds are the heart of the experiment. For this rea- 
son, it would seem reasonablSN that NSF would thoroughly review 
both the6e systems and the systems that preceded them at each 
university before delegating or expanding the grant administra- 
tive authorities. However, NSF did not conduct this type of 
review. 

NSF could have <3one a better job monitoring the experiment 
to assure that it was on course toward its go^ls. Based on our 
review, we found that accountability for grant expenditures was 
a problem at one university participating in the experiment, 
that special grant conditions were n6t monitored, that Phase II 
began without finalizing how to administer individual^'t^rants 
under the terminated master grants, and that communication be- 
tween NSF and the universities needs to be improved. 

NSF should assure that the universities are informed of the 
changes.^ modifications ,' etc. / to the experiment in a tir^ly man- 
ner; closely monitor the universities' use of the experiment's 
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authorities to assure that delegated authorities are used proper- 
ly; and review the OPAS policies and procedures for each partici- 
pating university to assure that the OPAS meets NSF's requirejnents 
fdr policies and procedures before the authorities are delegated 
to the university)'. 

An evaluation plan 

NSF needs to improve its evaluation of the , grant administra- 
tion experiment. At the time of our review, NSF had not developed 
its evaluation plan for Phase II. Phase II needs to be thoroughly 
evaluated by an official or team independent of those managing 
the experiment before any consideration is given to expanding the 
experiment further. The OPAS mechanism should be the focus of 
the evaluation. Because of the potential effect on future Federal 
grant administration policies, NSF should not expand the experi- 
ment further until the evaluation is complete and the results are 
assessed. . j 

FINANCIAL ACCOUNTABILI TY ^ . 
FOR, INDIVIDUAL GRANTS 

" NSF's experiment in grant administration permits researchers 
with NSF grants at participating universities to spend funds from 
one NSF grant on other scientifically related NSF grants. How- 
ever, the funds will be reported to NSF as having been spent on 
the grant they were awarded for, not on the grant they were spent 
on. That is, funds spent for one grant can be reported as having 
been spent on ariother. Some financial accountability for indi- 
vidual grant^ will be lost, since the a ctual expenditures for each 
related grarrt might not be the same as the expenditures reported . 

RECOMMENDATIONS 

We recommend that the Director of the National Science Foun- 
dation tai>:e the following actions to preserve the experiment's 
potential to improve research grant administration, while at the' 
same time assuring that* there will be adequate accountability for 
Federal research grant funds. 

— Require that each university's OPAS have an official 
independent of the participating departments who can 
assure that each department is exercising the delegated 
authorities properly, and who has or has available the 
scientific expertise necessary to review and approve 
actions • 

— Require that NSF review each university's OPAS to assure 
that^the university Jias established a system that can 
act responsibly before any delegations of prior approval 
authorities are made. \* 

— Require that all OPAS actions document (1) the description 
of the request, (2) the scientific reason for the request, 
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and (3) the soUrce of th^ fund/3 being rebudgeted, for re- 
budgeting actions on 'grants with special grant conditions. 

-^Require th^t (1) each university report to the cognizant 
NSF official all OPAS' actions on any grant whenever the 
cumulative O^AS actipns (excluding pre-award costs) exceed 
25 percent of^.the grant's direct costs; and (2) NSF assure 
that each part^acipating .university is aware that its OPAS 
is responsible \f or monitoring all actions on grants with 
special grant cdnditibns. 

^.^....^►KPequire that retroactive approvals of actions needing prior 
approval (1) document the reasons why prior approval was 
not obtained in a timely manner, and (2) certify that ap- 
proval would have been given had the request been submittedg|| 
on time. / ^/g 

— Develop a .'pfiase II evaluation" plan and.assuire that the 
necessary resources are available to carry it out. The 
evaluatidn shotild ijae-lude a thorough review of each uni- 
versity* s O^AS poYicies, procedures, and actions, and be 
conducted by of facial ( s ) independent of those managing the 
experiment . 

•Closely monitor :he universities'* use of the experiment's 
authorities and provide those responsible for managing the 
experiment at the\univer sities with information on. changes, 
modifications, etc\, to the experimenx in a timely manner. 

— Ensure that applicabre>'JTSTNj;^gulations or grant agreements 
exi^licitly provide that the \tjthority to 'approve pre-award 
costs cannot impose an obligation on the Unit.ed States 
prior to the availability of appropriations. 

AGENCY COMMENTS AND OUR RESPONSE ^ « ^ 

NSF and 0MB reviewed and commented on a draft of this report. 
NSF generally concurred with the conclusions presented in our re- 
port, and believes the report should improve the prospect that the 
experiment's concepts will be given favorable. consideration by the 
Congress and other Fede:ral . agencies . NSF divided its comments 
into threfe categories: (1) general comments; (2) comments on our 
recommendations; and (3) suggestions on "apparent" errors. The 
general comments are comments and suggestions on what NSF per- 
ceives to^ be imprQvements or clarifications that could be made in 
the report. 'In comments on our recommendations, NSF agreed with 
or planned ,to consider most of our recommendations. It provided, 
additional information contrary to that previously given to us 
which affected two recommendations. The recommendation regarding 
special grant conditions originally required that each university 
provide information to iJSF to allow it to monitor these conditions 
It has been revised to allow OPASs to be responsible for assuring 
that special grant * conditions are not violated. The recommenda- 
tion requires that NSF assurp that each participating university 

' - 



is aware of its responsibilities. We deleted the o their recommen- 
dation. It is no longer necessary to recommend that t^SF provide 
adequate audit coverage for the experiment's grants or return the 
responsibility to the cognizant audit agencies since NSF informed 
us that the cognizant audit agencies currently have this responsi- 
bility. The recommendation regarding ensuring that pre-award 
costs do not impose an obligation on ^the United States prior to 
the availability of the appropriation was' added to the report af- 
ter NSF had officially commented on the draft. NSF has not had 
the opportunity to comment on it. 

The list of ^suggestions on "apparent" errors provides addi- 
tional information or clarifications NSF wanted us* to incorporate 
into the report and we have generally done this.- Their comments 
and our responses to them ar'e in appendix I. 

^ 0MB agreed with the basic conclusion of the draft report 
that the NSF experiment can have important benefits in terms of 
eliminating red tape and improving Federal-university relations. 
0MB' s comments clarified its position on the relatedness concept's 
effect on accountability. These cotnments and our response^, to 
them are in appendix II. ^ . 
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NSF'S COMMENTS AND GAP'S RESPONSE 
'national science foundation 

WASHINGTON DC .20550 < 

^ nsf ^ 

r April 1^, 1982 

OFFICE OF THE 
OtRECTOR 



Mr. Morton A. ^ers , Director 
Program Analysis Divisi-on 
United States General Accounting 
Office 

Washington, D.C. 20548 



Dear Mr. Myers: 

i ^ 

We are responding to your letter of March 18, 1982, asking* for comments on 
your draft report on the "AAU-NSF Experiment" in grant adHTinist ration . 

We are pleased GAO found that delegation of prior approval authorities to 
university OPAS systems increases the efficiency and economy of research grant 
administration, and that the relatedness concept increases the researcher's 
flexibility in allocating costs among scientifically or technically related 
grants, and could reduce problems wi*fVi cost transfers and time and effort 
reporting . 

We are especially pleased that GAO and 0MB staff regard this initiative as 
promising. Your report should improve the prospect that it will be given 
favorable consideration by the Congress and Federal ageaci^es^. Your suggestion 
that the cognizant Congressional committees cpnsider the concept of 
relatedness is important because its full value will only be realized if all 
Federal agencies which support research u^e it. 



On page 1-7 GAO notes that it undertook its review because o^ the increasing 
concern for how Federal iresearch grant funds are administered and the 
experiment's potential, effect on accounting for these funds. The AAU-NSF 
experiment was undertaken in the belief that the key problem in 
Federa!|^university relations is not how grant funds are administered^ but is, 
r.ather, that disagreements over financial accountability are caused by an 
inadequate definition ^nd understanding of the basic grant relationship. As 
the ^}ational Commission cn Research Aoteu, the deterioration ir^ ~ 
Federal-university relajtions is associatf^d ^ith fiscal and administrative 
problems. These problems led NSF to experiment with redefining the basic 
^ relationship by questionirig, for example, the traditional procurement-oriented 
notion that costs of research can and must be precisely allocated to 
individual-grant- projects. The experiment is testing a modest modification of 
that notion by assuming that the Government often is supporting an individual 
project whicfi is a part of a researcher's ongoing program of research. Less 
financial precision in allocating costs to individual proj^icts is not 
^recessarily less accountability. Indeed, it may well be that clarifying roles 
and responsibilities and prpyiding better criteria for the decisions that OPAS 
systems make, can contribute to more effective allocation of resources and to 
clarifying both Fedet^al and grantee accountability, financial and.atherwise . 
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In the three enclosures to this letter we address ourselVes to your comments 
on the project and your ^recommendations . Our comments are of three types: (1) 
general comments and suggestions on what we perceive to be^improvements or 
clarifications that could be made in the report; (2) comment^ on specific GAO 
recommendations"; and (3) a listing of apparent errors in the report that you 
may wish to correct. 

We appreciate the opportunity to comment on the draft report. The 
"experiment" and your report on it should lead to further consideration of 
these important issues. ^ 

Sincerely yours. 



4^' 



jfehn B. S laugh 
Director 




Enclosures 



As 
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ENCLOSURE 1 



General Comments 



1 The GAO comments on the management of the experiment assume that the 

experiment should have been ' 'conductedUith a degt'ee of rigor chat we beli^ave 
would have been counterproductive. <5A0 asks for goals that can be specified f 
in measurable ternfs so that changes and- results can be measured. The 
experiment is in policy development and involves a multitude of variables.. It 
is' different from an experiment in which hypotheses can be formulated with 
such precision that the data will give a measurable yes or no ^inswer. in the 
. experiment we tried an approach, modified it to deal with the problems it 
, caused, and now find that those modifications seem to have produced a 
successful result. It is not methodologicaTly^sound to state that the 
ftx p/^rlTHPnt fthnnl d have be ^n nriT^ ^vr>hnH ,^rrf^"^r*^ rigorous fashion. ^ 

! In the experiment we have been examining delegations, new types of 
authorities, OPAS systems, documentation, appropriate roles and 
responsibilities, criteria for decisions, scierttific^ reviews of , decisions , and 
so on. The report suggests that before phase li was undertaken, nsf shoul-d 
have approved OPAS systems, emphasized the need for the traditional type of i 
documentation, and required that there be a second scientiriq approval of 
scientific decisions. The report's implication that Issues, some of which 
only tTeveloped during the course of the experiment, could or should have been 
resolved before Phase II was undertaken is not consistent with the nature of . 
the experiment. Even with Phase II, we may not have sufficient data or 
experience to resolve all these issues to everyohe's satisfaction." We believe 
the report should recognize that these'-are important issues that should be 
resolved as soon as possible, not that they should have been resolved before, 
the experiment was completed. , ^ 

3 Page 4-9 of the draft report suggests that NSF should have completed the 

evaluation of the master grant phase before moving to Phase il. As the report 
notes, there were a number of problems with the master grapt concept. When 
these were recognized, the master grant approach was discontinued. Phase II 
used the same condepts as in the master grant, with, the substitution of 
"relate^Sness" for "aggregation." -We^believe that 'continued evalu/ition of the " ' 
master grant approacn would not hav<?*Been productive, ^f t^r tfiscussions with 
the participating institutions, we concluded that the Phase II approach had a 
high probabilityof - success, so NSF expanded the experiment to generate more 
data by includingr.^essentially all NSF grants at the , participating' 
institution^ The number of OPAS actions in the master grant phase was much 
smaller thar/had been anticipated*. We also added three institutions that we 
believed would be especially usefu^^q us in reacting to the concepts being 
tested. ' , - . . . 
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Page 4-12 of the draft report suggests that there should have been more 
careful review and approval of OPAS systems before Phase II of the experiment 
was begun* Throughout the experiment we have been evaluating OPAS systems. 
Not only are different systems needed in different institutions, but OPAS 
systems are a variable in the management of research. The functioning of an 
OPAS is so intertwined with questions of required approvals, documentation* and 
justification that we wanted to. learn from grantees' experiences with 
different OPAS systems rather than prescribe a priori what such systems should 
be. Therefore, in Phase II NSF did not want to prescribe or specifically 
approve OPAS systems in advance ( though they were discuslsed with 
participants). We consciously chose to encourage th^ institutions to use 
their best judgment in developing OPAS systems that would most effectively 
serve, the purposes of research management, so long as key university officials 
understood the purposes of the experiment and the OPAS met the requirement 
-that there must be an independent review of investigator-initiated actions. 
Only now, with the review of large numbers of OPAS actions, does it make sense 
to begin to define what minimum OPAS responsibilities should be. We expect to 
do that in the near future. Interestingly, some participants have made 
changes in their OPAS systems based on their experience during Phase II. 

Page 5-6 of the draft report suggests that NSF should have been requiring more 
documentation and should not have been permitting use of certification at one 
institution. Again, these suggestions are inconsistent with the fact that we 
are experimenting with documentation and certification. The amount and nature 
of docxmentation is one of the variables we are trying to examine* In any 
future implementation, we hope to be able to specify what documentation is 
necessary for various types of approvals, and under what circumstances a form 
of certification might be acceptable. 

Page 4-8 of the draft report* suggests that NSF management of the project 
should have provided more information and guidance to participants. The 
example used was the case of one participant which had difficulty converting 
from the master grant phase to Phase II, and asked for detailed guidance on 
how to manage the transition. That was the only participant which had that 
type of problem. NSF staff consulted with this institutipn and concluded that 
the problem was one. of rigidity in its accounting system. They were told that 
they, not IjSF, were in^thebest position to handle the problem and, consistent 
yith the experimentjs intent to enhance grantee responsibilities and capacity, 
they should handle it, and NSF would ratify any additional approvals that were 
necessary. They did so, and NSF gave the necessary approvals. I 

Beginning on page 4-3, the draft report presents information indicating some 
doubt about financial accountability at one university. GAD* s> conce'rns Vere 
{}) that the university's accounting system was deficient, making it difficult 
to assure grant fund accountability, and (2) that the OPAS u^ider the master 
grant phase only provided for approvals by the Department Chairman. With 
respect to (1), over the yekrs there have been criticisms by federal agencies, 
generally acknowledged by the university, of some lack of financial accounta- 
bility at the university. NSF recognized that including the university in the 
experiment might pose some risk, but concluded that the experiment should not 



ERIC 



47 



53 



APPENDIX I APP'ENDIX I 



be limited only to universities having no such difficulties. Because of the 
concerns expressed by GAO, NSF staff made an on-site review and determined 
that the institution is making a concerted effort to improve its financial 
management system. Even so, the financial information in the Controller's 
^ffice still was running several weeks behind on a real time basis. However, 
( it was determined that, as is common practice at many institutions, financial 
information on individual grants is maintained in the departments. This 
information was reliable and was being maintained in a timely manner. 
Inasmuch as investigators were relying on this departmental information in 
making decisions involving the expenditure of granr funds, NSF concluded that 
OPAS actions would entail no loss of financial accountability for the pxirposes 
of the experiment, with respect to (2), it was agreed by representatives of 
NSF and the university before Phase II began that the university's "Grants 
Office" would be included in the approval process .Md would review all actions 
initiated under the expanded delegation of approvalauthority. 

There are several references in the report to the concept of relatedness. ' 
While the concept is seen as a means of addressing audit problems — 
particularly cost transfers and sane time and effort probl^s — it 
nevertheless is cast in a somewhat negative light, i.e^, producing a limited 
loss of financial accountability. For example, in the Digest (p. vii) the 
report states that "expenditures made for related research grants are reported 
to the NSF as having been spent on the grants they were awarded for, not on* 
the grants they were actually spent on." Yet on page 1-4 of the report GAO 
acknowledges that "some costs may be legitimately assigned to more than one 
source" and that "sometimes a researcner needs to maKe some legitimate but 
retroactive reallocation of charges, resulting in cost transfers." Th-e 
concept of relatedness is based on the premise that investigators pursue a 
program of research funded by multiple sponsors. The sponsors have an 
interest in various aspects of an investigator's overall research program and 
provide support for a portion of that program through an often somewhat 
arbitrarily defined "project." In carrying out a research program an 
investigator incurs expenses for supplies, equipment, travel, personnel, and 
so on. These expenditures often are allocable to two or more of an 
investigator's prbjects. The research overlaps and there is no way precisely 
to measure the benefits that accrue to any project in direct relationship to* 
the expenditure of funds. Cor^equently, investigators often allocate costs to 
projects in a subjective manner, sometimes on the basis of the availability of 

^ funds. To assume that the concept of relatedness results in a loss Of 
financial accountability is to assume that there is at present a discreteness 

^or separability Hn individual research projects which does npt usually exist. 
Indeed, the concept of relatedness may reflect reality better than the notion 
of financial accountability by project , th.at is assumed in the report. 
,< 

Page' 4-13. of the draft report states that NSF requested and was given 
pennission by the cognizant audit agencies - DHHS and DCAA - to assume 
responsibility fdt the audit of all grants under the experiment. NSF did not 
assume responsibility for auditing the grants covered by the experiment. We 
made arrangements with the cognizant audit agencies, in compliance with OMB 
Circular A-88, to perform site visits to review OPAS systems ^nd determine the 
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adequacy of documentation. The ajTrangements did not include provision for NSF 
to take over the audits of any NSF grants. The audits of all NSF grants 
continue to be the responsibility of cognizant audit agencies as part of their 
regularly scheduled audits of universities. However, in meetings with the 
universities, some of which were attended by representatives of the cognizant 
audit agencies and GAO staff, we did state that in the event of audit 
disallowances which could be attributable to actions associated with the , 
experiment, NSF would reserve the right to disagree with any disallowance of 
expenses associated with any such actions taken in good faith. 

It) Finally, inasmuch as the^experimental phase of the project is essentially 

compl*ete, the report should clarify that GAO's recommendations do not solely 
relate to the conduct of the experiment but are matters that NSF should 
consider in any implementation. 



APPENDIX I 



APPENDIX 



7 



ENCLOSURE 2 



Comments on GAO Recommendations on Pages 5-8 through 5-10 



1 The first recommendation, that each university's OPAS include an official 

capable of providing the scientific expertise necessary to review and approve 
actions/ assumes an answer to a question which NSF is examining. The need for 
a second scientific review is not as obvious as GAO assumes. In some cases a 
department chair clearly exercises that responsibility, in many cases, 
however, it is doubtful whether a departm^t chair has the expertise to do 
that or Is Inclined to do so even if he *Sir she does. The chair's review often 
may be a managerial review, including a check for impropriety. The role of 
the department chair and the need for a federal requirement for a second 
scientific judgment are issues which NSF hopes to resolve before* any 
» implementation. 



2 The second, third and fourth recommendations deal with OPAS systems and 
actions. NSF regards CPAS systems and the requirements for CPAS actions as 
variables with which we have* been experimenting, in our evaluation we will 
consider the GAO recommendations in establishing criteria' for OPAS systems, 
how they are reviewed and the type of guidance furnished grantees for their 
use. 

3 We agree with the fifth recommendation, requiring special documentation for 
retroactive approvals, and expect to follow it in any implementation. 

4 The s'ixth recommendation deals with a Phase ii evaluation plan. NSF 
recognizes the need for an evaluation of Phas^ II. The NSF Audit Office is 

• performing a limited evaluation of Phase II. The ^cope includes reviews of 
participating universities' OPAS policies, procedures and actions with the 
primary objective of determining the uses being made of the prior approval 
authorities and the risks associated therewith. The NSF -Director also is 
establishing an NSP- ad hoc evaluation committee, made up of NSF officials not 
directly involve<? in the experiment, to review Phase II and make 
* recommendations on ai^y future NSF implementation. NSF management will 
consider the findings and recommendations of the ad hoc committee and the 
Audit Office, together with information provided by other operating elements 
of the Foundation and the participating institutions, in deciding on any 
further actions or implementation. 

5 GAO's seventh recommendation, dealing witJ monitoring the universities' use of 
the authorities and providing timely information to universities, appears 
unnecessary in the light of NSF's evaluation activities and the fact that the 
experiment is essentially complete. 
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The eighth recommendation. is not appropriate inasmuch as NSF has not assumed 
responsibility for auditing ^ny NSF grants at the participating institutions. 
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Suggestions on- Apparent Errors 



17 The objectives of the experiment as stated on page ii of the digest are so 
abbreviated as to be misleading^ They should be stated as they are on pp. 1-1 
and 1-2. 

18 Page 1-1], paragraph 2, should note that NSF discussed the nature of the 
e^P^rinient with GAO, some Congressional staff, 0MB and others before it began. 



19 Pa^e 1-3, paragraph 2, line 2, add after the word research "...on an 
individual project." 

ZO page 1-10, line 17, delete the word "supposed" and substitute "NSF also takes 
approjgriate action..." 

21 Page 1-11, line 12, should read "...devote a substantially different amount of 
effort..." (either up or dovm) . 

22 I^age 1-17, line 14, the entire phrase beginninq "... it is notified .i." 
should be deleted as NSF does not so notify grantees. 

23 Page 2-13, line 10, add "Some of this additional effort was a one-time cost 
due to the changes." 

24 Page 2-16, line 7, add "These examples demonstrate the value of experimenting 
in exposing difficulties that need to be considered before any 
implementation ." 

25 Page 3-3, line 10, shbuld read "...attempt to resolve some time and effort 
reporting problems..." 

26 Page 4-6, the last sentence states that "NSF did not delegate responsibility 
for monitoring special grant conditions to the OPAS's..." That is not 
correct. The grantees agreed that OPAS authorities would be exercised except 
if prohibited by special conditions in individual grants. Thus, 'to exercise 
OPAS responsibilities grantees must monitor speci-al grant conditions.- 
Moreover, Article 5(d) of the grant terms and conditions requires that OPAS 
actions be consistent with the grant conditions. "Grant conditions" include 
special conditions. 

27 .Page 5-2, paragraph 2, should recognize that paperwork increases were probably 

a- one-time Effect due to the changes. 

2g Page 5-9, Recommendation #4 (2), should be changed to recommend that the OPAS 



ERIC 



51 



63 



APPENDIX I 



APPENDIX I 



should monitor special conditions* 

29 Page 5-10, last recommendation, should recommend only that audit 
responsibility be retained by the cognizant agencies. 

30 On Table 1-1 on page 1-15, no-cost extensions are approved by the NSF Grants 
Officer. The dollar figure in the' reference to alterations and renovations 
has been increased to $10,000 with the October 1981 revision to NSF F.L. 118. 
This newly revised F.L. 118 also no longer lists special approvals for news 
release costs or rental or lease of facilities consistent with changes in 
A-21. The purjchase of generiil purpose equipment is approved by the NSF Grants 
Officer, not the OP AS. 
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GAO'S RESPONSE TO NSF.* S COMMENTS 



The numbers of the responses helfSw correspond to the 
numbered paragraphs of the April 16, J1982, letter from John 
Slaughter, Director of the National Science Foundation. 

ENCLOSURE 1 * ^ 

1. We believje that NSF needs goals and criteria to assess the 
effect the experiment's changes are having on research 
grant administration. We do not agree that determining 
goals in measurable terms and establishing criteria for 
success w/HDuld have introduced a degree of rigor that would 
be counterproductive. Goals and criteria are needed in ' 
any experiment; we believe they could have been established 
by NSF without unreasonably restricting flexibility. 

2. The issues discussed here are critical to the experiment. 
Although NSF is experimenting with these issues, it still 
needs to have adequa,te safeguards to assure that Federal 
funds are appropriately spent. Detailed responses on these 
issues are included in our response to points #4, #5/ and 
#11 of NSF's letter. 

3. This section of the report, beginning on p. 32,' presents the 
facts concerning only NSF*s evaluation of the Master Grant 
phase. We did not suggest that NSF should have completed 
its evaluation of the Master Grant phase's aggregation- con- 
cept. However, we believe NSF should have reviewed and ap- 
proved the OPAS systems before Phase II began, as discussed 
in our response to point #4^of NSF's letter. 

4. We believe NSF should have reviewed and approved the OPAS 
systems before implementing Phase' II (see p. 34). The OPASs 
are the heart of the experiment since they are responsible 
for reviewing and approving the newly delegated authorities 
and are intended to assure proper accountability *6ver NSF 
grant funds. Although we agree that NSF need not have pre- 
scribed a priori what OPAS systems should have been, we" 
believe NSF should have -established minimum acceptable cri- 
teria and thoroughly reviewed each system to assure that it 
had demonstrated the capability to handle the expansion 
responsibly . 

5. We understand that NSF is experimenting with the issue of 
documentation and certification (see p. 40). However, we 

. believe that when experimenting with certification, NSF 
should have required backup documentation as a safeguards 
Certification does not provide the reason for an OPAS 
action. It is impossible to determine whether applic- 
able policies and procedures have been followed without 
knowing the reason for an OPAS action. In addition, NSF 
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reserved the right to withdraw the delegated authorities 
if a university mismanaged them. NSF needs adequate docu- 
mentation review university management 'of the authorities. 

6. While NSF believes they were providing adequate guidance in 
this example (see pp." 31-32), university officials told. us 
that NSF's handling of the transition caused some problems 
and confusion. In addition, we found other ex,amples in which 
participants did not feel they"were adequately informed by 
NSF. Particularly because it is an experiment, we believe 
that NSF should assure that it provides each university with 

/ the necessary information and guidance to allow it to func- 
tion smoothly. 

7. Since NSF acknowledges that including this university^ (,see 
pp. 29-31) in the experiment might have imposed some risk, 
it is difficult to understand why NSF was not closely moni- 
toring the university's activities. Also, it is difficult 
to understand why NSF would allow a university criticized 
over the years for "some lack of financial accountability" 
to delegate all of the authority to review and approve 
grant administrative and budget changes to one individual 
for the Master Grant phase. We believe the decision by 
the university to include the "Grants Office" in the OPAS 
for Phase II will provide better accountability. 

8. We believe the relatedness concept has many positive aspects, 
as discussed in our report, even though it will result in a 
limited loss of financial accountability for individual re- 
search grants. We agree thsit the 'concept of relatedness may 
reflect reality better thar\ the notion of grant by grant fi- 
nancial accountability.^ Traditionally, research has been 
funded bn a discrete grant basis and accounted for in the 
same manner. NSF states that investigators often allocate 
costs in a subjective manner and sometimes on the basis of 
the availability of the funds but does not point out that 
this is contrary to Federal regulations. This should be 
noted. We do not object to redefining a grant to reflect 
more accurately what is actually occurring at the research 
level. However, we do believe that this is a matter that 
the cognizant congressidnal conmiittees should be aware of. 

9. ^ In interviews with NSF officials, we were told that NSF. re- 

quested and was given permission by the cognizant audit agen- 
cies to assume responsibility for the audit of all grants 
under the experiment. However, NSF now ritaintains that audit 
responsibility wa^ not shifted and continued to be the re- 
sponsibility of the cognizant audit agencies (see p. 34). 
Therefore, our recommendation that NSF provide adequate audit 
coverage or return the responsibility to the cognizant audit 
agencies is no longer necessary . 

10. Our recommendations relate to both> t^ie experiment and any en- 
suing implementation' of its concepHid . We wish to reiterate 
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that Phase II should be thoroughly evaluated before expand- 
ing the experiment. 

ENCLOSURE 2 

11. The first recommendation does not assume ^n answer; it recom- 
mends the minimum requirements thcCt we believe are necessary 
to assure accountability for NSF funds. We are .not requiring 
a second scientific review as NSF sugges|;s^ NSF already re- 
quires the OPAS to review actions for sc/ientific or technical 
need and propriety. Our recommendation was made to assure 
that the OPAS has or has available the expertise necessary 

to make this review. We have clarified th^wJwZ&rding of the 
recommendation to reflect this. ) 

12. While NSF regards OPAS systems and the requirements for OPAS 
actions as variables with which they are experimenti*^ng, we 
believe our recommendations constitute the minimum require- 
ments that should be implemented for OPAS systems and actions, 

f- 

13f No response required. 

14. We are looking forward to seeing the result^ of NSF's review 
of Phase II. However^ we wish to reemphasize the, necessity 
that the review be conducted by official (s) independent of 
those managing the experiment. 

15. This recommendation is one that is necessary throughout all 
phases of the experiment and any futur^e implementation* 

16. As discussed in our* response to point #9, we have deleted 
our recommendation in light of the additional information 
NSF provided. 

ENCLOSURE 3 ^ . . ' / 



Many of these "apparent" errors are additional information 
or clarifications supplied by NSF as noted below. 

17. Additional information added (see, p. i). 

18. Additional information added (see p. 1). 

19. Clarification made (see p. 2). 

20. Change made (see p, 60). ~ ~ 

21. Clarification made (see p. 61). 
22.. Change made (see p* 65). 

23, Additional information added (see p. 15). Y^^^, 
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24. We disagree with NSP's suggested addition to p. 16- We be- 
lieve that NSF should have reviewed the OPAS policies and 
procedures before delegating authorities to the universities 
to assure that the OPASs had the capability to handle the 

' delegated authorities (a thorough discussion of this univer*- 
sity'S' problems can be found beginning on p» 29). * 

25. Clarification made (see p. 22). 

26. The change that is indicated has been made on p. 31. Durixig 
the course of our review, NSF officials informed us that NSF 
did not delegate responsibility for monitoring special grajnt 
conditions to the OPASs. As showa in the example cited, at' 
least one university wa? not aware of this responsibility. 
We modified our recommendation to require NSF to assure that 
the OPASs are aware of their responsibili-ty to monitor spe-' 
cial grant conditions. 

27. We disagree — we 'did clarify this section (see p. 37) by 
noting that sbme of the increase was probably a one-time 
effect due to the changes, as NSF pointed out in its com- ' 
ments Csee point #23 of the letter) . 

28. As discussed in our response to point #26, the ^hange that 

^is indicated has been made. ' , ' . 

* 

29. Our recommendation has been deleted, as discussed on page 43. 

30. As discussed in the footnote on p. 60, several revisions 
were made to NSF's grant administration requirements which 
were not incorporated' into the draft since they were not in 
effect at the time our review was made. No-cost extensions 
were approved by the NSF policy officer prior to the change 
in March which gave this authority to the NSF grants officer,. 
The revisions noted in NSF*s comments have been incorporated 
into a footnote at the bottom of table 7. The approval of 
the purchase of general purpose equipment was changed to the 
NSF grants officer. 
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EXECUTIVE OFFICE OF. THE PR^IDENT 



Iw/J* * OFFICE OF MANAGEMENT AND BUDGET 

<\^^ . WASHING*rON. D.C. 20503 



APR 2 0 1982 



Mr. William J. Anderson 

Director, General Gov^ernment Division . 

U. S. General Accounting Office ■ ^ ^ . 

Washington, D. C. 20548, 

Dear Mr. Anderson: " . . - 

This is in reply to your letter of,^M,arcW%^t8 , 1982, requesting 
cpmments on the draft report, "NSP'^s^ Experiment in Research 
Grant Administration Jiooks Promising"' But ChaFiges Are Needed 
to Assure Accountability." The review focuS^'d' on experi- . 
ment by the National Science Po\andation and the . Association 
of American^Universi t ies in more f lexibJLe .proce'cteres for , 
.administering research .grants to universities. -Oc^ comments - 
are limited to those parts of the draft r^brt pertaining to 
0MB involvement. • s ' .^^^...^^^^^ ^^v.^- 

The draft report indicates on page 1-20 .that OMB^of fj^ials 
agreed that funds spent on one grant -could be reported' ynder 
another closely related grant, and that the peer review*' ,^ 
system would assure the scientific integrity of th^. relate^ 
projects. This appears to b^ an oversimplif ibatiorr t)f the e 
OMB position. While we agree that p^eer review '«is a li^eful 
control, final decisions on matters ^f ^ accpuntabilcityr rest, 
with the grantmaking agency. In some aase^ , ^one r^'rant nray 
involve seve^l\nelated ^ct»ivities; 4". o^her 'caSses^ a number 
of separate grants may be" made for related purposes. .^^In y 
either^ ease, 'an acceptable level of 'account ability must be' 
maintained.' ' - - . '""^^ : ^ 

OMB does not endorse, as the draftT dn;pl?.es:,''/t;be prfnciple of ^ ' 
chairging cp.sts to pne grant that .j^er^'^'ajcfcu^p^ in 

, another, ^owever, ^we do recognize' thaCrX.n k^gfm^fe ;^ases' it makes 
seTise to combine, the accounting" for ""clofeeiy'' rei-^ted grants, , 
permitting control" to ^ be ^fiq^^ained'/ dyer' 'th^ coTtibined' actiyi- 

\t\^^. Whether these combined, ^activiVi'es then, con^ one 
grart.t'.dt. mor-e than orie grant »is a' decisiW^'.be^'^t ;le£t:. t^^ the 

:-&pons6rlng agency,./ v"^\ 'V,: ^^'^^l r'-^ ^ 7'' 

We agcjpewlthi the -basic ^joriefixision 6/ the^^^draft' report that' ' . 
the..l}.^t experiment &an have iftportan-t benefits in terms pf 
ei-iminating ife?3, .tape, and ' iijiproving Federalruni, vets^rty relar, 
; bions.hipu^.-'*\Tli^-: draf^.repor.fc^.points- to/^^the need .for; effective 
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and timely agency raonitoring and audit *foliow-up to essure 
that the system is wojrkinq and t^hat necessary accountability 
is maintained. With^ such a follow-up system in place, we^ 
believe that the NSF exper^imen^t should continue. ° 
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GAO*S RESPONSE TO 0MB *S COMMENTS 



We are pleased that 0MB agrees (1) with the basic conclusion 
of the draft report that the nSF experiment can have important 
bene^it^ in terras of eliminating red tape and, improving Federal- 
university relationships and (2) that timely agency monitoring 
and,^dit follow-up are necessary to asslare that accountability 
is maintained. Although 0MB * s response indicated that the draft 
reporl: might have oversimplified their position on the related- 
ness concept, we both agree that an acceptable level of account- 
alDility must be maintained. W,e,also agree that in some cases 
it. makes sense to combine the financial accounting for closely 
related grants, permitting control to be maintained over the 
combined activities. However, we believe that since this is a. 
change in the way basic research grants are accounted for, it 
is a matter that the cognizant congressional committees should 
be aware of.! 



4r 



ERIC 



59 , 



71 



t i ' 



APPENDIX III 



APPENDIX III 



COMPARING THE STANDARD 'AND 
\. EXPERIMENTAL POST-AWARD SYSTEMS 

Post-award administration responsibilities for NSF grants 
are divided^ between NSF and the university as discussed in NSF's 

, Grant ^Policy Manual. 1/ Since the experiment focuses on the 
post-award administration of research grants, the following 
sections will compare the standard and experimental post-award 
policies and procedures used by NSF and its grantees* Areas 
of post-award concern include monitoring grant performance, 

, changing grant scope, objectives, or principal researcher,^ 
approving research expenditures not provided for in the grant 
coward/ changing tlie grant budget, and grant reporting require- 
ments . 

MONITORING GRANT PERFORMANCE 

Under the standard system, the grantee is responsible for 
monitoring the performance of the grant to assure adherence to 
(i) performance goals time schedules, or other requirements 
which may be appropriate to the grant, and (2) sound management 
practices and organizational poliJcies. NSF may make site visits 
as appropriate to keep informed of the progress of the work and 
to review grantee management control systems. NSF also takes 
approprifate action based on its review of progress reports and 
final technical reports. ' ^ 

Under the experimental system, -responsibilities remain the 
same.* * - - 

CHANGING GRANT SCOPE, OBJECTIVES, 
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OR PRINCIPAL RESEARCHER 



Under the standard system, neither the material under study 
nor the objective of the grant stated in the proposal is to be 
changed without prior NSF approval. Such changes should be 
proposed to the program officer by th^^researcher in a letter 
countersigned by a*n authorized univenBtey official. Since NSF^'s 

'decision to support a research proposal is based to a consider- 
able extent upon its evaluation of the proposed researcher's 
knowledge' of the i*i^ld of study ahd 'capabilities to conduct the 
research in an ^fTifcient- and productive manner, ^the university 
must notify ^NSF if the researcher plans to relinquish active 
direction of the grant. The university may either initiate grant 
closeout procedures or nominate a substitute researcher to con- 

Hinue the grant. 



1/Several modifications vQre made to the .Grant Policy Manual in 
" March 1981 and a'gai'n in October 1981 but .are not included irr^ 
this report since they were not in effect at the time the ac- 
tions reviewed were made. 
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If the substitute researcher is approved by NSP, the grant 
will be appropriately amended. If NSF does not approve the sub- 
stitute, the grant will be closed out* If the researcher will 
devote a substantially different amount of effort to the work 
than anticipated, he or she must inform university officials and 
the NSF program officer. If either determines that the reduction 
in effort Vitould be substantial enough to impair the success of 
the project, the NSF grants officer will be asked to take appro- 
priate action such as replacing the researcher, terminating the 
grant, or modifying the grant. 

None of the research or substantive effort under an NSF 
grant may be contracted, or othervise transferred to another 
organization, without prior NSF approval. In the event the need 
arises to contract part of the research effort after a grant has 
been made, the grantee must submit tlF'the NSF grants officer the 
propose"<3 performance statement and^biidget, a statement indicating 
the basis for selection of the contractor, and. a justification 
of the proposed arrangement. The request must be signed by the 
researcher and endorsed by an authorized university official. 

The experimental system has the same requirements with oneT^ 
exception. If a researcher wants to contract part of a grant's 
effort, he or she submits to the OPAS the proposed performance 
statement and budget, a statement indicating the basis for selec- 
tion of the contractor, and a justification of the proposed 
arrangeme.nt . T^ie OPAS reviews and either approves or declines 
^the. request . No NSF approval is required.. 

APPROVING RESEARCH EXPENDITURES NOT 
PROVIDED FOR IN THE GRANT AWARD 

Under the standard system, if an expenditure is proposed 
in the grant budget and justified in the narrative, provision 
for it in the grant constitutes NSF approval unless thg grant 
specifically indicates the contrary. If provision is not made 
in the proposal, prior written approval of NSF's* grant officer, 
program officer, or of the university-wide OPAS 1/ as required, 
should be obtained before action is t%ken to purchase a partic- 
ular it^m or service (see table 7) since it cannot be charged 
to an NSF grant without such approval. ^ 



l/The university-wide OPAS is called the UwOPAS to distinguish 
r it. from the master grant OPAS. 
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Table 7 ' 
Approving Changes in the Grant Awards 

Appro va 1 Requi red Under 



Prior Approval Authorities 

Fund transfers (aggregation) a/ 

Expenditures . for related grants, 
(relatedness ) a/ 

No-cost extension b/ 

Altei;ations and. renovations 
under $1,000 c/ d/ 
$1, 000 or more 



Standard 
System 

not allowed 



Experimental 
System 



not allowed 

NSF program officer 



UwOPAS 

NSF grants officer 



Contractual (third party) costs - NSF grants officer 
Equipment 

Special purpose: $1,000 or more NSF program ''off icer 



General purpose 



Cumulative expenditures which 
exceed budgeted amount by 
more than, 25% providing the 
cost is under $1,000 c/ 

News release costs d/ 

Pre-award costs 

V 

Commercial production or dis- 
tribution of boolcs, films, etc. 

Rental or lease of facilities d/ 

Travel 

Each foreign trip 
Cumulate domestic travel 
expenditures which, exceed 
125% of amount budgeted, or 
$500, whichever is greater c/ 
^ Dependent foreign travel 
• ' 

Hiring consultants not pro- 
vi|g^e<$ for in grant 
proposal or award c/ 



NSF grants officer 



UwOPAS 

NSF program officer 
Not allowed 

NSF grants officer 
NSF grants officer 

NSF program officer 



UwOPAS 

NSF program officer 



UwOPAS 



CPAS 

CPAS 
CPAS 



CPAS 
CPAS 

CPAS 



CPAS 
NSF 

grants 
officer 



CPAS 
CPAS 
CPAS 

CPAS 
CPAS 

CPAS 



CPAS 
CPAS 



CPAS 



(Footnotes 6n the bottofn of p. 47.) 
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To carry out its* responsibilities for adhering to grant 
terms and conditions and monitoring grcCnt performance, ^.each 
university is supposed to have a system* to ensure that author- 
ized cjfficials provide necessary organizational approvals in 
advanae of any action that would result in either the perform- 
ance or modification of an NSF grant where such approvals 
are required. The university must designate an appropriate 
official or officials to review and approve the types of actions 
described above ► - The designated*- of f icia 1 may not be the re- 
searcher or any official having, direct responsibility for the 
conduct of the grant. Preferably, the official (s) should be 
the same official (s) who sign(s) or countersign (s ) those typ^s 
of requests which, require submission to, and approval by, NSF. 

NSF requires that the university's prior appro\^ls be 
documented. The documentation should include a justification 
of the action requested, including identification of the budget 
categories affected. An appropriate official at a management 
level should review the request for policy permissibility and 
fund availability. An appropriate official, at an administrative 
level above that of the requestor shoil Id review the request 
for ^scientific propriety, ^research relevance, and effective 
use of the institution* s resources. The request should receive 
final' approval by a designated university official. 

" ' NSF uses- its program and- grant^^ management staffs to carry 
out its portion of grant monitoring responsibilities which in- 
volve furnishing prior approvals. Two copies of all requests 
for'bu<^get changes requiring NSF prior approva l' mus t be signed 
by the' researcher and countersigned by the grantee*s authorized 
jre'presentative , and sent to either the NSF program officer: or 
grants officer. The request should clearly state which budget 
items are to be changed and by what amourvts, and should explain 
the reasons for the change. 



V (Footnotes to table 7) 
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a/Phase II substituted the relatedness concept for the aggregation 
concept. — ^ 

X>fK modification was m^de *to NSF-^s Qrant Policy Manual in March * 

"I 1981 which gave .this approval authority to the NSF grants officer. 

c/ln 1977, NSF delegated these prior approval authorities to any 
university which established an organiz;ational prior approval 
system. We use the acronym UwOPAS (university-wide OPAS) to 
distinguish it from the master grant OPAS'. 

d/The October 1981 revision' to NSF Form Letter 118 increased the 
\^ dollar figure for alterations and renovations to $10,000 and no 
- - longer rfequires special approval for news release costs or rental 
• or lease of facilities. 
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As in the standard system, in the experimental system an * 
expenditure proposed in the grant budget and justified in the 
narrative is considered approved by NSF unless the grant specif- 
ically indicates otherwise. However, OPAS approval replaces 
approval of the NSF grants officer, program officer, and the 
university-wide OPAS for expenditures not included in the pro- 
posal. Also, as 'in the standard system, NSF requires that the 
OPAS approvals be documented. 

CHANGING THE GRANT BUD GET ^ 

Under the standard ^system, if the researcher wa^its to trans- 
fer funds from one approved grant budget line item to one that re- 
quires prior approval, such prior approval must be obta^ed' (as 
summarized in table 7 J . When a budget change requires NSF ap-r 
proval, two copies of a request, signed by the researcher and the 
grantee's authorized official, should be sent to the cognizant NSF 
offibe. The request should clearly state which budget -items are 
to be changed, by what amount, and the reasons for the chcinges. 

If the action does not require prior approval, the grantee 
may make the change as lon^ as the expenditure meets the require- 
ments of the Federal cost principles. NSF elected not to impose 
on its grantees the following optional requirements of 0MB Circu- 
lar A-llO: (1) prior approval for transfers l^etween direct and 
in<3irect cost categories o*f the grant budget; and (2) restrictions 
in transfers of funds arric^ng direct cost categories for grants in 
which the Federal share exceeds ?100,000* 

expenditure may not be changed to an NSF grant prior to 
eff^tive date of *t;he granit* However, commitments requiring 
g lead times, such as for major items of equipment, may be 
itiated prior to the effective date at the risk of the grantee, 
for delivery subsequent to that date. If a grant is made and such 
items are approved, NSF funds may be. expended for them on or after 
the effective date of the grant* 

If additional time beyond the expiration date is required to 
assure adequate completion of th^e original scope of work within 
the funds already made available, a request for^a rio-cost grant 
extension must be sent to the program officer. The request should 
dnclude a summary of progress to date, funds remaining, and plans 
to complete that part of the grant for which the extension is be- 
ing requested. The need for an extension of time must be justi- 
fied . 

Under the experimental system, if a researcher wants to 
transfer funds from one approved grant budget line item to another 
line item that requires, pr*or Approval, prior approval must be ob^ 
tained from the OPAS. If the action ^oes not require prior ap- 
proval, the grantee may make the change as. long as the expenditure 
meets the requirements of the Federal cost principles.. No NSF ap- 
proval is required. 
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A17 authority newly delegated to the OPAS under the experiment 
allows grantees to incur costs before the/ef fective date of the 
grant* However, the costs incurred are at the risk of the grantee. 
The experiment allows the grantees to-be reimbursed for costs in- 
curred prior to the award (pre-award costs) provided that (1) the 
OPAS determines for each cost item that the advance funding was 
necessary for the effective and economical conduct of the research; 
(2) the costs are bth^rwise allowable under the the terms of the 
anticipated grant that will provide the funds; and (3) the costs 
were incurred within the. 90-day period immediately preceeding the 
effective date of the grant. No NSF approval is required. 

The OPAS was also delegated the -authority to grant no-/ 
extensions. The experiment allows the OPAS to extend the 
tion date of any grant for up to 6 months. The OPAS is r^qi 
to review summaries of progress, funds remaining, and plans for 
the completion of the grants for which extensions are requested. 
The researcher is required to justify the. need for the extension. 
No NSF approval is required. 

<3RANT REPORTING REQUIREMENTS 

Under the standard system, NSF established the following re- 
porting requirements for its reseajrch grants. Financial reporting 
is done on a quarterly basis with each grantee updating a list of 
grant expenditures, called the Federal Cash Transactions Report 
(FCTR), supplied by NSF, The FCT^^ lists each grant's net award 
and cumulative disbursements through the prior quarter and pro- 
vides space for the university to supply the riet disbursements 
for the current quarter. NSF has designed' its procedures to ex- 
tract final financial information from the FCTR, 

NSF requires annual progress reports for each grant.' The 
progress report should include a. summary of: (1) overall pro- 
gress, including results obtained to date, (2) current problems 
or favorable or unusual developments, (3) work to be performed 
in the next ^grant period, and (4) other inf orrtration pertinent 
to the type of grant being Supported . 

NS? requires a Final Project Report within 90 days of the 
expiration of a grant. This form contains a summary of the com- 
pleted research and space tp iyidicate the status of submission 
of final technical information items for program use. The final 
technical items required to be submitted include abstracts of 
theses f publication cita^tions and reprints of articles, data on 
scientific collaborators, information on inventions, and a tech- 
nical description of the research and results. 

The reporting requirements for the experiment's grants, r^e- 
ma'^ined basically the 'Same except for financial reporting. In th^^j 
Master Grant pViase, eac}i master grant appeared as a single award 
on' the FCTR sent to the grantee quarterly. Expenditure data en-r 
tared by the grantee was the single cumulative total for all 
grants unde"r each ^master grant. The experiment had the same' 
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requirement for the annual progress report for each individual 
grant in the master grants. The^ Final Project Report was to be 
submitted on an aggregated basis for all grants under each master 
grant. The final technical information items listed and any other 
unique reports or end products specified for particular grants 
were to be submitted on an individual basis for each grant. In 
Phase II, reporting requirements are the same as for the standard 
system. 

NSF also required copies of OPAS approval forms, or equiv- 
alent summary records, documenting actions taken on all master 
grants to be sent to NSF on a periodic basis. Phase II origin- 
ally did not require copies of OPAS actions to be sent to NSF, 
except for requests of two or more researchers to relate grants. 
In June 1981, NSF asked all Phase II participants to send copies 
of their OPAS actions to NSF. 
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